-- Logs begin at Thu 2022-06-30 02:17:39 UTC, end at Thu 2022-06-30 04:36:38 UTC. -- Jun 30 04:06:40.898704 dv-cinder-846842-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 04:06:40.907602 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 04:06:40 2022] *** Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: nodename: dv-cinder-846842-7-iscsi Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: machine: x86_64 Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: clock source: unix Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: pcre jit disabled Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: detected number of CPU cores: 4 Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: current working directory: / Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: detected binary path: /usr/bin/uwsgi-core Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: your processes number limit is 47680 Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: your memory page size is 4096 bytes Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: detected max file descriptor number: 2048 Jun 30 04:06:40.909686 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: lock engine: pthread robust mutexes Jun 30 04:06:40.911007 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: thunder lock: enabled Jun 30 04:06:40.911007 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 04:06:40.911007 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 04:06:40.954658 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: Python main interpreter initialized at 0x558c16def9c0 Jun 30 04:06:40.954658 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: python threads support enabled Jun 30 04:06:40.954658 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: your server socket listen backlog is limited to 100 connections Jun 30 04:06:40.954658 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: your mercy for graceful operations on workers is 90 seconds Jun 30 04:06:40.955043 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 04:06:40.955043 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: *** Operational MODE: preforking *** Jun 30 04:06:40.955343 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: *** uWSGI is running in multiple interpreter mode *** Jun 30 04:06:40.955343 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: spawned uWSGI master process (pid: 103664) Jun 30 04:06:40.955547 dv-cinder-846842-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 04:06:40.956203 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: spawned uWSGI worker 1 (pid: 103665, cores: 1) Jun 30 04:06:40.956401 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: spawned uWSGI worker 2 (pid: 103666, cores: 1) Jun 30 04:06:40.956563 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 04:06:41.611517 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 04:06:41.619071 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 04:06:42.723824 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 04:06:42.723824 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: from cryptography.utils import int_from_bytes Jun 30 04:06:42.724549 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 04:06:42.724549 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: from cryptography.utils import int_from_bytes Jun 30 04:06:42.727395 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 04:06:42.727395 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: from cryptography.utils import int_from_bytes Jun 30 04:06:42.727852 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 04:06:42.727852 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: from cryptography.utils import int_from_bytes Jun 30 04:06:45.174478 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 04:06:45.175188 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 04:06:45.175285 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 04:06:45.175634 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 04:06:45.175702 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 04:06:45.175776 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 04:06:45.175844 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 04:06:45.175913 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 04:06:45.176190 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 04:06:45.176319 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.176474 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 04:06:45.176631 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.176807 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.176905 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.177330 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.177475 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.177475 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.177644 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.177809 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.177953 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.178109 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.178251 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.178479 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.178576 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.178734 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.178830 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.178989 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.179089 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.179328 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.179438 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.179627 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.179725 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-7-iscsi {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.179973 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.180120 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.180296 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.180442 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-7-iscsi {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.180536 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.180630 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.180850 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.180953 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.181146 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.181249 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.181458 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.181559 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.181758 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.181852 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.182077 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.182253 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.182359 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.182679 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.182980 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.183212 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.183329 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.183526 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.183615 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.183834 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.183928 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.184144 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.184323 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.184480 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.184637 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.184790 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.184940 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.185111 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.185290 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.185407 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.185578 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.185710 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.185944 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-7-iscsi {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.186030 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.186269 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.186359 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.186559 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.186716 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-7-iscsi {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.186866 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.187030 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.187295 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.187424 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.187601 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.187738 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.187904 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.188060 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.188214 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.188373 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.188511 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.188685 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.188816 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.189007 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.189130 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.189340 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.189485 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.189723 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.189863 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.190001 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.190120 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.190255 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.190376 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.190572 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.190675 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.190870 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.191010 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.191203 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.191306 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.191499 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.191584 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.191794 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.191878 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.192036 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.192123 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.192336 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.192420 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.192645 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.192737 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.192964 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.193136 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.193531 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.193692 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.193832 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.193962 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.194083 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.194203 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.194322 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.194452 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.194581 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.194709 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.194839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.194960 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.195077 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.195224 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.195358 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.195478 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.195606 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.195725 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.195887 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.196018 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.196195 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.196319 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.196497 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.196664 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.196798 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.196926 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.197089 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.197214 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.197394 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.197525 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.197701 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.197831 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.197998 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.198119 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.198310 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.198433 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.198625 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.198754 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.198921 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.199042 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.199244 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.199368 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.199577 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.199713 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.199914 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.200047 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.200168 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.200286 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.200467 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.200591 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.200867 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.200991 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.201110 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.201228 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.201358 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.201486 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.201630 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.201753 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.201937 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.202060 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.202258 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.202388 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.202552 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.202681 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.202800 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.202919 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.203069 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.203212 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.203388 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.203521 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.203698 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.203830 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.203994 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.204118 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.204295 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.204429 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.204594 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.204727 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.204884 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.205008 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.205183 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.205305 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.205480 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.205611 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.205781 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.205902 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.206079 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.206199 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.206375 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.206506 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.206671 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.206793 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.206969 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.207131 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.207293 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.207426 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.207588 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.207718 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.207890 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.208010 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.208193 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.208316 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.208530 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.209066 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.209066 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.209302 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.209430 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.209551 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.209678 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.209813 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.209948 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.210142 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.210351 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.210480 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.210607 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.210735 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.210984 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.211128 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.211267 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.211389 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.211507 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.211624 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.211742 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.211867 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.212001 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.212121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.212254 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.212373 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.212491 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.212613 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.212740 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.212859 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.212978 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.213096 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.213213 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.213331 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.213458 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.213576 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.213701 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.213823 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.213973 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.214139 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.214273 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.214446 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.214571 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.214749 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.214872 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.215052 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.215212 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.215377 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.215511 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.215690 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.215835 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.215971 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.216089 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.216300 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.216476 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.216604 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.216724 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.216856 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.216988 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.217108 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.217228 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.217453 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.217640 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.217787 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.217918 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.218039 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.218157 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.218353 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.218540 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.218671 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:06:45.218802 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.218961 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.219088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.219337 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.219537 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.219670 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.219791 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.219911 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.220029 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.220197 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.220329 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.220516 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.220616 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.220821 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.220915 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.221125 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.221218 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.221429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.221523 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.221740 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.221841 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.222051 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.222145 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.222371 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.222464 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.222677 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.222789 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.222982 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.223074 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.223315 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.223419 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.223617 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.223717 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.223923 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.224024 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.224304 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.224470 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.224975 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.225115 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.225255 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.225380 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.225500 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.225622 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.225750 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.225881 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.226010 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.226138 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.226268 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.226395 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.226514 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.226640 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.226799 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.226923 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.227127 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.227267 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.227459 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.227596 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.227778 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.227902 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.228089 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.228222 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.228397 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.228536 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.228707 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.228831 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.229011 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.229136 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.229317 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.229451 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.229621 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.229754 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.229929 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.230058 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.230367 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.230529 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.230529 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.230766 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.230888 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.231007 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.231363 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.231491 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.231609 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.231726 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.231843 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.231961 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.232088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.232216 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.232338 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.232463 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.232663 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.232837 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.232990 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.233118 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.233237 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.233356 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.233498 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.233632 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.233841 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.234018 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.234148 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.234280 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.234402 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.234532 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.234731 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.234906 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.235036 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.235216 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.235338 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.235476 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.235607 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.235728 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.235947 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.236135 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.236266 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.236398 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.236520 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.236639 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.236829 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.237004 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.237149 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.237284 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.237417 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.237544 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.237671 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.237797 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.238014 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.238191 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.238331 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.238454 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.238574 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.238700 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.238908 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.239115 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.239251 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.239387 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.239514 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.239634 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.239935 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.240370 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.240585 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.240709 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.240709 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.240940 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.241070 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.241189 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.241453 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.241573 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.241691 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.241824 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.241945 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.242070 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.242189 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.242306 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.242433 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.242561 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.242681 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.242799 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.242923 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.243041 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.243207 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.243338 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.243496 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.243627 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.243829 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.243951 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.244134 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.244267 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.244457 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.244592 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.244756 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.244893 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.245055 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.245178 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.245358 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.245492 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.245665 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.245788 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.245969 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.246093 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.246273 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.246408 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.246569 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.246704 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.246865 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.246988 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.247183 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.247307 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.247489 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.247614 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.247790 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.247912 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.248086 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.248208 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.248385 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.248520 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.248683 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.248806 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.248998 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.249120 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.249304 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.249433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.249608 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.249731 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.249912 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.250034 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.250240 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.250369 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.250545 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.250746 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.250880 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.250998 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.251159 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.251297 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.251555 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.251674 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.251802 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.251923 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.252049 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.252169 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.252339 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.252462 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.252650 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.252772 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.252953 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.253084 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.253264 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.253386 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.253567 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.253690 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.253881 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.254005 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.254182 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.254305 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.254494 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.254615 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.254793 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.254923 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.255137 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.255263 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.255826 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.255973 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.256108 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.256237 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.256358 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.256478 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.256596 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.256729 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.256858 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.256988 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.257109 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.257281 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.257411 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.257539 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.257659 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.257784 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.257938 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.258069 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.258253 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.258388 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.258561 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.258683 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.258870 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.258992 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.259203 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.259413 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.259536 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.259663 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.259819 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.259942 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.260122 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.260247 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.260434 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.260559 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.260803 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.260935 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.261063 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.261183 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.261346 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.261604 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.261733 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.261866 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.261986 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.262109 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.262232 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.262429 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.262561 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.262761 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.262892 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.263146 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.263278 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.263440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.263572 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.263738 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.263868 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.264039 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.264162 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.264343 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.264467 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.264651 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.264774 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.264956 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.265078 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.265261 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.265382 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.265559 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.265681 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.265870 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.265992 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.266173 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.266302 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.266474 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.266612 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.266772 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.266894 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.267076 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.267243 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.267415 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.267539 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.267724 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.267853 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.268029 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.268165 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.268337 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.268458 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.268634 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.268763 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.268934 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.269068 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.269247 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.269369 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.269552 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.269676 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.269849 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.269985 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.270161 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.270290 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.270468 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.270599 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.270790 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.271019 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.271355 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.271869 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.271991 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.272109 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.272250 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.272373 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.272490 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.272608 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.272725 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.272844 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.272974 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.273490 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.273490 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.273730 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.273849 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.273966 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.274093 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.274219 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.274345 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.274463 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.274581 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.274698 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.274828 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.274949 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.275066 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.275201 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.275320 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.275515 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.275638 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.275762 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.275881 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.276032 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.276154 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.276338 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.276461 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.276644 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.276767 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.276950 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.277074 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.277251 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.277373 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.277560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.277681 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.277875 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.277996 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.278218 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.278443 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.278573 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.278775 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.278897 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.279088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.279254 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.279426 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.279710 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.279846 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.280045 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.280183 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.280364 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.280483 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.280690 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.280823 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.281014 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.281144 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.281321 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.281433 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.281628 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.281723 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.281930 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.282025 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.282234 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.282336 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.282543 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.282650 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.282846 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.282984 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.283171 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.283386 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.283510 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.283630 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.283748 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.283873 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.284050 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.284187 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.284348 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.284471 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.284645 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.284767 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.284945 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.285077 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.285246 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.285376 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.285556 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.285682 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.285860 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.285984 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.286165 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.286295 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.286483 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.286716 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.287222 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.287347 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.287467 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.287593 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.287712 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.287831 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.287959 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.288086 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.288205 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.288323 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.288448 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.288569 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.288696 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.288816 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.288934 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.289051 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.289240 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.289372 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.289550 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.289680 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.289901 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.290036 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.290204 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.290335 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.290506 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.290630 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.290805 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.290929 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.291202 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.291350 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.291473 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.291591 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.291710 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.291828 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.292094 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.292215 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.292343 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.292463 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.292581 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.292699 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.292867 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.292999 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.293171 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.293301 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.293468 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.293591 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.293771 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.293902 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.294068 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.294191 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.294376 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.294498 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.295042 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.295192 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.295365 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.295486 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.295664 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.295796 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.295975 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.296096 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.296275 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.296396 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.296572 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.296706 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.296874 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.296996 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.297169 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.297298 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.297476 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.297608 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.297774 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.297903 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.298072 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.298201 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.298370 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.298502 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.298672 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.298794 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.298974 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.299146 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.299281 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.299410 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.299593 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.299714 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.299896 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.300016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.300196 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.300318 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.300492 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.300615 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.300792 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.300915 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.301089 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.301207 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.301399 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.301521 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.301670 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.301801 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.301985 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.302092 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.302313 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.302420 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.302617 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.302722 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.302972 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.303179 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.303338 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.303502 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.303645 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.303780 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.303915 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.304048 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.304178 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.304306 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.304469 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.304603 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.304768 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.304908 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.305064 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.305199 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.305361 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.305498 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.305657 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.305784 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.305960 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.306087 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.306263 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.306398 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.306558 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.306685 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.306856 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.306984 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.307187 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.307286 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.307496 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.307580 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.307801 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.307885 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.308107 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.308201 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.308417 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.308509 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.308726 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.308809 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.309039 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.309124 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.309346 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.309431 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.309652 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.309737 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.309959 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.310044 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.310261 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.310345 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.310575 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.310668 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.310884 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.310968 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.311218 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.311356 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.311558 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.311763 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.311887 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.312006 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.312249 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.312373 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.312491 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.312618 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.312739 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.312857 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.312975 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.313093 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.313282 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.313413 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.313599 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.313723 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.313900 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.314029 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.314202 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.314326 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.314507 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.314637 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.314806 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.314929 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.315123 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.315250 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.315431 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.315555 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.315739 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.315894 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.316047 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.316169 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.316350 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.316470 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.316654 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.316774 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.316955 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.317078 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.317257 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.317379 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.317559 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.317691 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.317915 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.318227 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.318611 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.318742 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.318870 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.319001 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.319143 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.319265 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.319265 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.319490 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.319490 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.319728 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.319728 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.319966 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.320086 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.320204 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.320323 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.320451 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.320611 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.320737 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.320919 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.321051 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.321231 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.321356 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.321610 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.321742 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.321860 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.321991 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.322122 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.322368 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.322493 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.322619 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.322741 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.322865 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.322997 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.323175 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.323428 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.323559 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.323739 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.323869 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.324046 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.324172 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.324354 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.324484 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.324655 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.324785 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.324955 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.325077 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.325262 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.325385 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.325583 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.325718 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.325891 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.326020 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.326191 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.326315 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.326491 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.326625 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.326807 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.326930 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.327124 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.327250 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.327449 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.327585 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.327761 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.327884 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.328089 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.328212 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.328398 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.328522 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.328724 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.328854 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.329115 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.329237 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.329420 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.329545 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.329729 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.329849 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.330044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.330166 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.330363 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.330488 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.330664 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.330787 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.330973 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.331110 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.331307 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.331458 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.331626 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.331827 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.331953 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.332072 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.332236 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.332493 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.332636 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.332757 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.332878 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.333004 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.333124 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.333252 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.333477 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.334039 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.334165 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.334284 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.334284 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.334537 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.334660 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.334781 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.334930 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.335052 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.335235 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.335375 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.335498 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.335624 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.335745 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.335924 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.336057 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.336230 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.336363 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.336533 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.336664 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.336840 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.336980 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.337141 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.337266 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.337440 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.337563 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.337759 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.337891 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.338059 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.338183 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.338367 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.338498 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.338675 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.338807 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.338980 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.339127 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.339305 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.339429 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.339606 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.339743 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.339912 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.340035 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.340207 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.340342 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.340508 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.340638 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.340815 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.340944 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.341115 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.341236 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.341431 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.341553 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.341730 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.341867 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.342080 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.342212 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.342342 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.342591 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.342715 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.342835 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.342959 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.343079 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.343263 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.343385 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.343531 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.343663 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.343831 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.343965 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.344130 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.344252 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.344454 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.344575 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.344762 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.344892 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.345068 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.345332 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.345457 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.345575 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.345695 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.345823 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.346002 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.346139 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.346313 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.346436 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.346632 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.346765 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.346931 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.347055 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.347253 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.347390 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.347558 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.347683 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.347863 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.347985 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.348168 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.348299 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.348465 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.348596 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.348766 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.348889 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.349112 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.349666 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.349801 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.349936 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.349936 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.350172 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.350292 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.350420 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.350586 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.350708 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.350827 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.350946 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.351066 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.351249 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.351371 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.351489 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.351614 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.351732 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.351849 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.351979 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.352187 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.352311 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.352430 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.352659 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.352785 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.352914 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.353035 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.353154 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.353296 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.353420 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.353616 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.353752 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.353919 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.354042 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.354236 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.354361 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.354551 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.354676 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.354865 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.354988 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.355202 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.355341 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.355537 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.355663 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.355814 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.355946 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.356126 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.356248 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.356438 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.356560 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.356745 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.356868 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.357059 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.357183 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.357384 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.357507 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.357668 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.357826 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.357968 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.358168 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.358293 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.358496 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.358619 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.358805 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.359088 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.359266 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.359426 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.359561 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.359735 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.359859 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.360044 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.360175 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.360348 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.360470 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.360653 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.360777 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.360957 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.361089 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.361261 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.361385 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.361613 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.361767 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.361906 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.362028 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.362163 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.362344 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.362466 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.362584 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.362782 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.362910 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.363086 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.363208 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.363414 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.363531 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.363720 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.363815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.364056 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.364150 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.364364 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.364538 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.364710 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.364804 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.365021 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.365221 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.365464 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.365566 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.365778 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.365872 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.366091 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.366194 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.366395 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.366490 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.366701 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.366794 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.367011 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.367134 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.367341 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.367437 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.367647 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.367741 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.367953 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.368057 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.368262 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.368356 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.368578 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.368679 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.368889 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.368991 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.369204 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.369296 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.369511 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.369604 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.369817 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.369921 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.370126 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.370219 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.370463 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.370633 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.370781 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.370921 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.371128 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.371278 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.371596 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.371725 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.371912 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.372044 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.372221 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.372358 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.372542 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.372666 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.372889 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.373029 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.373150 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.373276 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.373417 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.373541 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.373728 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.373852 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.374030 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.374162 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.374328 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.374460 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.374644 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.374766 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.374946 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.375068 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.375294 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.375432 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.375681 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.375814 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.375935 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.376053 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.376218 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.376436 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.376561 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.376774 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.376898 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.377084 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.377344 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.377477 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.377693 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.377817 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.378003 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.378125 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.378305 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.378429 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.378621 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.378745 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.378922 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.379046 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.379228 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.379351 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.379540 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.379664 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.379845 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.379969 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.380144 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.380334 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.380906 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.381046 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.381169 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.381288 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.381417 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.381538 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.381666 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.381795 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.381916 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.382048 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.382168 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.382288 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.382407 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.382548 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.382734 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.382870 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.383072 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.383228 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.383351 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.383471 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.383591 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.383719 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.383847 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.383992 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.384116 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.384291 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.384413 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.384588 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.384714 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.384896 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.385031 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.385195 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.385333 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.385499 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.385621 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.385804 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.385918 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.386118 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.386229 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.386426 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.386522 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.386738 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.386832 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.387047 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.387198 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.387384 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.387472 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.387691 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.387785 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.387999 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.388094 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.388312 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.388400 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.388620 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.388705 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.388938 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.389026 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.389242 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.389327 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.389545 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.389638 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.389922 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.390017 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.390177 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.390263 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.390488 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.390705 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.390800 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.391041 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.391156 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.391388 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.391486 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.391722 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.391980 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.392078 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.392316 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.392404 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.392629 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.392722 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.392933 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.393035 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.393250 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.393352 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.393558 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.393724 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.393866 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.393951 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.394169 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.394253 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.394476 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.394571 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.394780 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.394866 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.395084 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.395280 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.395411 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.395499 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.395720 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.395804 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.396063 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.396146 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.396364 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.396531 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.396667 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.396821 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.396977 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.397138 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.397273 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.397454 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.397581 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.397772 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.397915 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.398071 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.398230 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.398384 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.398542 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.398697 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.398854 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.399015 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.399188 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.399397 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.399482 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.399724 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.399821 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.400047 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.400135 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.400368 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.400452 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.400679 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.400773 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.400990 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.401076 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.401298 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.401388 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.401597 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.401692 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.401921 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.402110 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.402256 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.402395 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.402532 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.402679 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.402832 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.403034 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.403227 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.403364 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.403510 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.403653 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.403807 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.403959 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.404095 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.404236 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.404408 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.404552 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.404717 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.404864 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.405038 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.405179 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.405370 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.405511 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.405698 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.405839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.406084 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.406236 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.406387 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.406522 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.406664 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.406799 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.406933 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.407076 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.407250 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.407393 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.407526 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.407669 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.407802 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.407943 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.408079 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.408245 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.408387 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.408552 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.408700 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.408854 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.408988 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.409195 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.409355 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.409503 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.409645 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.409788 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.409929 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.410065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.410199 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.410352 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.410496 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.410637 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.410771 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.410904 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.411037 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.411217 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.411378 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.411559 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.411751 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.412364 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.412516 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.412652 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.412795 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.412938 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.412938 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.413282 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.413418 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.413551 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.413694 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.413852 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.413994 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.414128 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.414267 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.414413 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.414548 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.414681 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.414814 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.414947 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.415080 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.415264 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.415264 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.415520 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.415663 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.415796 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.415962 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.416142 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.416142 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.416488 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.416624 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.416769 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.416912 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.417053 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.417188 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.417321 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.417465 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.417599 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.417742 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.417884 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.418027 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.418170 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.418304 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.418436 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.418583 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.418718 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.418851 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.418983 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.419144 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.419304 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.419449 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.419584 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.420061 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.420195 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.420328 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.420469 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.420611 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.420745 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.420878 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.421011 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.421143 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.421294 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.421437 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.421570 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.421711 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.421845 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.421977 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.422184 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.422320 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.422462 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.422596 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.422729 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.422876 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.423017 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.423279 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.423429 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.423593 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.423811 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.424007 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.424154 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.424323 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.424463 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.424691 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.424846 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.424991 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.425125 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.425306 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.425446 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.425587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.425735 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.425877 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.426011 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.426211 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.426370 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.426507 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.426654 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.426846 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.426987 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.427267 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.427894 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.427894 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.428170 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.428170 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.428434 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.428575 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.428718 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.428718 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 04:06:45.428982 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.428982 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.429253 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.429582 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.429901 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.430216 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.430524 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:06:45.430767 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103665) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 04:06:45.586979 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO dbcounter [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Registered counter for database nova_api Jun 30 04:06:45.588504 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Registered counter for database nova_api Jun 30 04:06:45.608831 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG oslo_db.sqlalchemy.engines [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:06:45.610750 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:06:45.616292 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writer thread running {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:06:45.617774 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:06:45.673260 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.context [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0b3dfcb-6461-41ce-bb34-7ec7929e49fb(cell1) {{(pid=103666) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 04:06:45.674487 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.context [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0b3dfcb-6461-41ce-bb34-7ec7929e49fb(cell1) {{(pid=103665) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 04:06:45.677384 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG oslo_concurrency.lockutils [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:06:45.678631 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:06:45.678933 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG oslo_concurrency.lockutils [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:06:45.679745 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG oslo_concurrency.lockutils [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:06:45.680243 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:06:45.681046 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:06:45.681688 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG oslo_concurrency.lockutils [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:06:45.682980 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:06:45.683793 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO dbcounter [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Registered counter for database nova_cell0 Jun 30 04:06:45.685008 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Registered counter for database nova_cell0 Jun 30 04:06:45.689258 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO dbcounter [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Registered counter for database nova_cell1 Jun 30 04:06:45.690418 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Registered counter for database nova_cell1 Jun 30 04:06:45.698208 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG oslo_db.sqlalchemy.engines [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:06:45.700500 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG oslo_db.sqlalchemy.engines [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:06:45.703807 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:06:45.705619 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:06:45.706097 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writer thread running {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:06:45.708366 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writer thread running {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:06:45.712178 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:06:45.713622 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:06:45.851588 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO dbcounter [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Registered counter for database nova_cell0 Jun 30 04:06:45.857321 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO dbcounter [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Registered counter for database nova_cell0 Jun 30 04:06:45.858628 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG oslo_db.sqlalchemy.engines [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:06:45.863408 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writer thread running {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:06:45.867015 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_db.sqlalchemy.engines [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103665) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:06:45.871939 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writer thread running {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:06:46.197522 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: WARNING keystonemiddleware.auth_token [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 04:06:46.198103 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 04:06:46.204752 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: WARNING keystonemiddleware.auth_token [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 04:06:46.204885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 04:06:46.543991 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: WARNING keystonemiddleware.auth_token [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 04:06:46.546163 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 04:06:46.550305 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: WARNING keystonemiddleware.auth_token [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 04:06:46.552130 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: WARNING keystonemiddleware.auth_token [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 04:06:46.555581 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c16def9c0 pid: 103666 (default app) Jun 30 04:06:46.557568 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c16def9c0 pid: 103665 (default app) Jun 30 04:06:46.557725 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:06:46.558838 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-614ada2c-34b7-4aa5-86f0-9275d63a3889 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001739 Jun 30 04:06:46.559280 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Thu Jun 30 04:06:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:02.345739 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:02.346949 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Jun 30 04:08:02.353142 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:02 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:02.363674 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_api:SELECT=3 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:08:02.364374 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_cell0:SELECT=3 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:08:02.365632 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_cell1:SELECT=3 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:08:02.367135 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:08:02.799826 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-e5bf1189-7912-47c4-b0e1-662a17314aab admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:02.831188 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-e5bf1189-7912-47c4-b0e1-662a17314aab admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476921 Jun 30 04:08:02.831706 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 30 04:08:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:08:04.893138 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:04.894347 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-93886f1a-d78d-494d-9440-df0c8053064c None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Jun 30 04:08:04.895000 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:04.958869 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-85b7e62c-1738-42b0-a855-148257df2e10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:04.977944 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 04:08:04.977944 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: warnings.warn(msg) Jun 30 04:08:05.010545 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-85b7e62c-1738-42b0-a855-148257df2e10 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108567 Jun 30 04:08:05.013681 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 30 04:08:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:08:05.026093 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=3 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:08:05.027050 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell1:SELECT=3 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:08:05.028117 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell0:SELECT=3 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:08:05.029470 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:08:05.248694 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-a68a364b-210e-4c35-86fa-3634ebd2dd01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:05.251182 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 04:08:05.251182 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jun 30 04:08:05.309864 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-a68a364b-210e-4c35-86fa-3634ebd2dd01 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290309 Jun 30 04:08:05.311141 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 30 04:08:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:08:07.408445 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-85b7e62c-1738-42b0-a855-148257df2e10 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:07.409502 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-85b7e62c-1738-42b0-a855-148257df2e10 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Jun 30 04:08:07.409903 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:07.523894 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-30a40d1a-a2ba-4cff-bed3-5e96571ecfb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:07.541657 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 04:08:07.541657 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jun 30 04:08:07.561887 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-30a40d1a-a2ba-4cff-bed3-5e96571ecfb9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146078 Jun 30 04:08:07.562465 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 30 04:08:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 04:08:07.574618 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-f9b52a0f-cbbf-48f7-9d74-a1f297748f73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:07.576142 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 04:08:07.576142 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: warnings.warn(msg) Jun 30 04:08:07.611301 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-f9b52a0f-cbbf-48f7-9d74-a1f297748f73 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040324 Jun 30 04:08:07.612071 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 30 04:08:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:08:09.684832 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-30a40d1a-a2ba-4cff-bed3-5e96571ecfb9 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:09.685849 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-30a40d1a-a2ba-4cff-bed3-5e96571ecfb9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 30 04:08:09.686226 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:09.749430 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-cab8bf55-e200-404e-a952-c2758cc046a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:09.768601 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-cab8bf55-e200-404e-a952-c2758cc046a9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076528 Jun 30 04:08:09.771145 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 30 04:08:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 04:08:09.781429 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-27cfb94f-4342-403a-89d8-95d6224b4e8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:09.806119 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-27cfb94f-4342-403a-89d8-95d6224b4e8b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028486 Jun 30 04:08:09.806683 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 30 04:08:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:08:11.951437 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-cab8bf55-e200-404e-a952-c2758cc046a9 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:11.952467 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-cab8bf55-e200-404e-a952-c2758cc046a9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jun 30 04:08:11.952933 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:12.014356 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-c6151d27-6f1d-49d1-99f0-179a53e2b658 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "vcpus": 2, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:12.033196 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-c6151d27-6f1d-49d1-99f0-179a53e2b658 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074481 Jun 30 04:08:12.033941 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 30 04:08:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:08:12.046816 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-dcb36ef2-fca2-4ee3-b58b-a3150cbe6018 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:12.070456 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-dcb36ef2-fca2-4ee3-b58b-a3150cbe6018 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027785 Jun 30 04:08:12.071021 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 30 04:08:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:08:14.224695 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-c6151d27-6f1d-49d1-99f0-179a53e2b658 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:14.226310 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-c6151d27-6f1d-49d1-99f0-179a53e2b658 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001921 Jun 30 04:08:14.226758 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:14.287767 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-7f9e1fa4-4da2-4dd7-9d97-31a8fd825ce1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:14.309614 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-7f9e1fa4-4da2-4dd7-9d97-31a8fd825ce1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076615 Jun 30 04:08:14.310325 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 30 04:08:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:08:14.327659 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-32bcf1f3-a72f-4257-a7b8-eca515c3c158 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:14.355889 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-32bcf1f3-a72f-4257-a7b8-eca515c3c158 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034687 Jun 30 04:08:14.356483 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 30 04:08:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:08:16.438224 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-7f9e1fa4-4da2-4dd7-9d97-31a8fd825ce1 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:16.439969 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-7f9e1fa4-4da2-4dd7-9d97-31a8fd825ce1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002369 Jun 30 04:08:16.441473 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:16.509498 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-6b5942e1-7a7c-403f-bcab-3229fcaf242b admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:16.534528 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-6b5942e1-7a7c-403f-bcab-3229fcaf242b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087243 Jun 30 04:08:16.535541 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 30 04:08:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:08:18.629695 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-7f9e1fa4-4da2-4dd7-9d97-31a8fd825ce1 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:18.630741 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-7f9e1fa4-4da2-4dd7-9d97-31a8fd825ce1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001649 Jun 30 04:08:18.631558 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:18.707014 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-06d71acc-c857-413a-aab2-4dd9ae7da909 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "disk": 1, "id": "1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:18.726404 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-06d71acc-c857-413a-aab2-4dd9ae7da909 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087100 Jun 30 04:08:18.727121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 30 04:08:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:08:18.742569 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-3c791bed-28fe-4ef4-ad8b-2f40112ce56c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:18.773566 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-3c791bed-28fe-4ef4-ad8b-2f40112ce56c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036912 Jun 30 04:08:18.781239 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 30 04:08:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:08:20.955506 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-06d71acc-c857-413a-aab2-4dd9ae7da909 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:20.956481 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-06d71acc-c857-413a-aab2-4dd9ae7da909 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Jun 30 04:08:20.956955 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:21.023354 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-82043064-d12d-433d-b894-8347e396d4ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:21.042587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-82043064-d12d-433d-b894-8347e396d4ce admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077573 Jun 30 04:08:21.043167 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 30 04:08:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:08:21.056465 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-1dc8dc7c-6e15-4f7c-bbbb-b856d2cea62b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:21.083164 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-1dc8dc7c-6e15-4f7c-bbbb-b856d2cea62b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030904 Jun 30 04:08:21.083805 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 30 04:08:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:08:23.255618 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-82043064-d12d-433d-b894-8347e396d4ce admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:23.256869 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-82043064-d12d-433d-b894-8347e396d4ce admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Jun 30 04:08:23.257311 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:23.323141 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-3bc3286b-be67-4d1b-8aa7-e243a0ea086b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "disk": 40, "id": "3", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:23.343530 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-3bc3286b-be67-4d1b-8aa7-e243a0ea086b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079881 Jun 30 04:08:23.344142 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 30 04:08:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:08:23.358226 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-ad15fc17-7386-4dc4-947e-ef0c0106807a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:23.384859 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-ad15fc17-7386-4dc4-947e-ef0c0106807a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031554 Jun 30 04:08:23.385506 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 30 04:08:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:08:25.484558 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-3bc3286b-be67-4d1b-8aa7-e243a0ea086b admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:25.485549 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-3bc3286b-be67-4d1b-8aa7-e243a0ea086b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 30 04:08:25.485940 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:25.545316 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-4d6230c0-3dad-4616-aa06-d3097445105f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "disk": 80}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:25.564138 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-4d6230c0-3dad-4616-aa06-d3097445105f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072083 Jun 30 04:08:25.564793 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 30 04:08:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:08:25.577203 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-f15e1009-90f9-4d9e-a689-e31b01e902bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:25.600729 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-f15e1009-90f9-4d9e-a689-e31b01e902bf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027222 Jun 30 04:08:25.601279 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 30 04:08:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:08:27.699777 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-4d6230c0-3dad-4616-aa06-d3097445105f admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:27.701532 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-4d6230c0-3dad-4616-aa06-d3097445105f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002267 Jun 30 04:08:27.702000 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:08:27.768142 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-018c2172-ade4-47fb-9157-1b578d6da043 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:27.787437 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-018c2172-ade4-47fb-9157-1b578d6da043 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079265 Jun 30 04:08:27.788051 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 30 04:08:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 04:08:27.800612 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-505b2654-9b67-488c-b952-1fb154cf4e8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:27.825457 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-505b2654-9b67-488c-b952-1fb154cf4e8e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028635 Jun 30 04:08:27.825967 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 30 04:08:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:08:52.234397 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-018c2172-ade4-47fb-9157-1b578d6da043 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:52.235501 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-018c2172-ade4-47fb-9157-1b578d6da043 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 30 04:08:52.235877 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:52.250424 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:08:52.311832 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-38efeaf6-0e22-4069-b38f-42d722ab5c50 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:52.328911 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-38efeaf6-0e22-4069-b38f-42d722ab5c50 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.086267 Jun 30 04:08:52.329430 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 30 04:08:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:08:53.251692 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-018c2172-ade4-47fb-9157-1b578d6da043 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:53.252738 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-018c2172-ade4-47fb-9157-1b578d6da043 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 30 04:08:53.253134 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:08:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:53.452167 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-6298688d-d028-4d38-a08a-5722f0d567d1 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:53.460626 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.wsgi [None req-6298688d-d028-4d38-a08a-5722f0d567d1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-6298688d-d028-4d38-a08a-5722f0d567d1 admin admin] Request method failure captured: Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Accept: application/json Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Accept-Encoding: gzip, deflate Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Connection: keep-alive Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Content-Length: 0 Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Host: 10.222.0.13 Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Openstack-Api-Version: compute 2.90 Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Openstack-System-Scope: None Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: User-Agent: python-novaclient Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Auth-Token: gAAAAABivSHV3Ro4MFWHFOjcTNKMvtKihNr7rDStXE1W3mw4iQbPn7jjdvXJhEgjOkjckU9fUxoW3lxBieEH5_H_a1S_m8kjA3C_N6uWtDRmUY0Av3fzS7BNUD7DMcqIUrnBQRyv0VIeVg7pBtkSsvoBbYrkujBkwIayIrGqh_RD8nsmMa8hVaQ Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Domain-Id: None Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Domain-Name: None Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Identity-Status: Confirmed Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Is-Admin-Project: True Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Domain-Id: default Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Domain-Name: Default Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Name: admin Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Role: admin,reader,member Jun 30 04:08:53.465528 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Roles: admin,reader,member Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_447338b8480048d8be1a3dac45927add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/447338b8480048d8be1a3dac45927add"}]}] Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Tenant: admin Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Tenant-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Tenant-Name: admin Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User: admin Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Domain-Id: default Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Domain-Name: Default Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Id: d70cac4e4add4da9a183025769b64cc8 Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Name: admin Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: method: > Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: exception: Flavor 42 could not be found. Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: action_args: {'id': '42'} Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:08:53.467088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:53.468044 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:53.469220 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-6298688d-d028-4d38-a08a-5722f0d567d1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:08:53.470391 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-6298688d-d028-4d38-a08a-5722f0d567d1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.076616 Jun 30 04:08:53.470391 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 30 04:08:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 04:08:53.477024 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-43076b63-b8c6-4842-9bb8-e712eb2310c3 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:53.480061 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:08:53.498888 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-43076b63-b8c6-4842-9bb8-e712eb2310c3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025706 Jun 30 04:08:53.499466 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 30 04:08:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:08:53.511839 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-c8e7bd60-28b1-462e-99b0-ef7fe5c7c497 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:53.544303 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-c8e7bd60-28b1-462e-99b0-ef7fe5c7c497 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.038104 Jun 30 04:08:53.544888 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 30 04:08:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:08:53.558405 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-75060bca-063b-40ff-8c31-7e18844bcf6c admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:53.567939 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.wsgi [None req-75060bca-063b-40ff-8c31-7e18844bcf6c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-75060bca-063b-40ff-8c31-7e18844bcf6c admin admin] Request method failure captured: Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Accept: application/json Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Accept-Encoding: gzip, deflate Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Connection: keep-alive Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Content-Length: 0 Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Host: 10.222.0.13 Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Openstack-Api-Version: compute 2.90 Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Openstack-System-Scope: None Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: User-Agent: python-novaclient Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Auth-Token: gAAAAABivSHV3Ro4MFWHFOjcTNKMvtKihNr7rDStXE1W3mw4iQbPn7jjdvXJhEgjOkjckU9fUxoW3lxBieEH5_H_a1S_m8kjA3C_N6uWtDRmUY0Av3fzS7BNUD7DMcqIUrnBQRyv0VIeVg7pBtkSsvoBbYrkujBkwIayIrGqh_RD8nsmMa8hVaQ Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Domain-Id: None Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Domain-Name: None Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Identity-Status: Confirmed Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Is-Admin-Project: True Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Domain-Id: default Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Domain-Name: Default Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Name: admin Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Role: admin,reader,member Jun 30 04:08:53.571850 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Roles: admin,reader,member Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_447338b8480048d8be1a3dac45927add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/447338b8480048d8be1a3dac45927add"}]}] Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Tenant: admin Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Tenant-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Tenant-Name: admin Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User: admin Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Domain-Id: default Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Domain-Name: Default Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Id: d70cac4e4add4da9a183025769b64cc8 Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Name: admin Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: method: > Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: exception: Flavor 42 could not be found. Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: action_args: {'id': '42'} Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:08:53.573440 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:53.574937 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:53.576233 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-75060bca-063b-40ff-8c31-7e18844bcf6c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:08:53.577463 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-75060bca-063b-40ff-8c31-7e18844bcf6c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.021799 Jun 30 04:08:53.577463 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 30 04:08:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 04:08:54.395124 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-c8e7bd60-28b1-462e-99b0-ef7fe5c7c497 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:54.396161 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-c8e7bd60-28b1-462e-99b0-ef7fe5c7c497 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 30 04:08:54.396685 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:08:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:54.602681 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-a0bae7bd-bd0b-4f45-a9cc-5c6558eb7143 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:54.608297 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.wsgi [None req-a0bae7bd-bd0b-4f45-a9cc-5c6558eb7143 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-a0bae7bd-bd0b-4f45-a9cc-5c6558eb7143 admin admin] Request method failure captured: Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Accept: application/json Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Accept-Encoding: gzip, deflate Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Connection: keep-alive Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Content-Length: 0 Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Host: 10.222.0.13 Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Openstack-Api-Version: compute 2.90 Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Openstack-System-Scope: None Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: User-Agent: python-novaclient Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Auth-Token: gAAAAABivSHWBmsJ2HqeS2TAJGUEm2Whij3X6OxY4VHAKON_SchXhAfFPNbUCUUvINRZzVH_mfCh3OUPoCUOJ_gWSTNGw4NN4u-tG03-oM8BFloSaxjhkW7I7YXs_aDesZrCykEot7FUzv1PmyBW1H3PhNmS7P3_map_RAKw_pekTInOrkDwXo8 Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Domain-Id: None Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Domain-Name: None Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Identity-Status: Confirmed Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Is-Admin-Project: True Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Domain-Id: default Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Domain-Name: Default Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Name: admin Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Role: admin,reader,member Jun 30 04:08:54.609815 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Roles: admin,reader,member Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_447338b8480048d8be1a3dac45927add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/447338b8480048d8be1a3dac45927add"}]}] Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Tenant: admin Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Tenant-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Tenant-Name: admin Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User: admin Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Domain-Id: default Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Domain-Name: Default Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Id: d70cac4e4add4da9a183025769b64cc8 Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Name: admin Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: method: > Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: exception: Flavor 84 could not be found. Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: action_args: {'id': '84'} Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:08:54.611065 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:54.612016 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:54.613121 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-a0bae7bd-bd0b-4f45-a9cc-5c6558eb7143 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:08:54.614153 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-a0bae7bd-bd0b-4f45-a9cc-5c6558eb7143 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068703 Jun 30 04:08:54.615547 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 30 04:08:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 04:08:54.621214 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-d2fa8287-30eb-41e1-85ad-a4c514810d3f admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:54.637093 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-d2fa8287-30eb-41e1-85ad-a4c514810d3f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019509 Jun 30 04:08:54.637597 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 30 04:08:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:08:54.648035 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-b4792fa0-467b-4802-9bd6-e5c16e46b537 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:54.662975 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-b4792fa0-467b-4802-9bd6-e5c16e46b537 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019024 Jun 30 04:08:54.663752 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 30 04:08:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:08:54.673734 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-2cd8ffc9-db73-4d2f-9f30-2cbb4d22f1a7 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:54.679777 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.wsgi [None req-2cd8ffc9-db73-4d2f-9f30-2cbb4d22f1a7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-2cd8ffc9-db73-4d2f-9f30-2cbb4d22f1a7 admin admin] Request method failure captured: Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Accept: application/json Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Accept-Encoding: gzip, deflate Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Connection: keep-alive Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Content-Length: 0 Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Host: 10.222.0.13 Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Openstack-Api-Version: compute 2.90 Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Openstack-System-Scope: None Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: User-Agent: python-novaclient Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Auth-Token: gAAAAABivSHWBmsJ2HqeS2TAJGUEm2Whij3X6OxY4VHAKON_SchXhAfFPNbUCUUvINRZzVH_mfCh3OUPoCUOJ_gWSTNGw4NN4u-tG03-oM8BFloSaxjhkW7I7YXs_aDesZrCykEot7FUzv1PmyBW1H3PhNmS7P3_map_RAKw_pekTInOrkDwXo8 Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Domain-Id: None Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Domain-Name: None Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Identity-Status: Confirmed Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Is-Admin-Project: True Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Domain-Id: default Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Domain-Name: Default Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Name: admin Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Role: admin,reader,member Jun 30 04:08:54.681429 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Roles: admin,reader,member Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_447338b8480048d8be1a3dac45927add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/447338b8480048d8be1a3dac45927add"}]}] Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Tenant: admin Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Tenant-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Tenant-Name: admin Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User: admin Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Domain-Id: default Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Domain-Name: Default Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Id: d70cac4e4add4da9a183025769b64cc8 Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Name: admin Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: method: > Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: exception: Flavor 84 could not be found. Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: action_args: {'id': '84'} Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:08:54.682763 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:54.683587 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:54.684818 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-2cd8ffc9-db73-4d2f-9f30-2cbb4d22f1a7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:08:54.685820 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-2cd8ffc9-db73-4d2f-9f30-2cbb4d22f1a7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012820 Jun 30 04:08:54.687381 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 30 04:08:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 04:08:55.495683 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-b4792fa0-467b-4802-9bd6-e5c16e46b537 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:55.496694 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-b4792fa0-467b-4802-9bd6-e5c16e46b537 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 30 04:08:55.497339 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:08:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:55.696403 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-27ad3c05-3dd6-4bf0-8899-b793e06bb006 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:55.702581 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.wsgi [None req-27ad3c05-3dd6-4bf0-8899-b793e06bb006 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-27ad3c05-3dd6-4bf0-8899-b793e06bb006 admin admin] Request method failure captured: Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Accept: application/json Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Accept-Encoding: gzip, deflate Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Connection: keep-alive Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Content-Length: 0 Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Host: 10.222.0.13 Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Openstack-Api-Version: compute 2.90 Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Openstack-System-Scope: None Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: User-Agent: python-novaclient Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Auth-Token: gAAAAABivSHXKYuZZ7tq7AQRlh3JdKFMCrPDxmHSOPb0hQRxlKN5dtC7YuDX-o-K-0mo9cD6LwB8qlYBMgpQgV174mAGg-It3Iq_JGxgEWFBM-QcWPOvTQ8J-ZSSZ78HTB2Wnqv7V1Sv9YDZ1g7pd518mABpU3M20Qgt6qcp36YhKWXRACjCQkI Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Domain-Id: None Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Domain-Name: None Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Identity-Status: Confirmed Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Is-Admin-Project: True Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Domain-Id: default Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Domain-Name: Default Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Project-Name: admin Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Role: admin,reader,member Jun 30 04:08:55.704060 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Roles: admin,reader,member Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_447338b8480048d8be1a3dac45927add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/447338b8480048d8be1a3dac45927add"}]}] Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Tenant: admin Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Tenant-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-Tenant-Name: admin Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User: admin Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Domain-Id: default Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Domain-Name: Default Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Id: d70cac4e4add4da9a183025769b64cc8 Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: X-User-Name: admin Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: method: > Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: exception: Flavor 451 could not be found. Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: action_args: {'id': '451'} Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:08:55.705560 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:55.706352 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: ERROR nova.api.openstack.wsgi Jun 30 04:08:55.707433 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-27ad3c05-3dd6-4bf0-8899-b793e06bb006 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:08:55.708462 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-27ad3c05-3dd6-4bf0-8899-b793e06bb006 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.074265 Jun 30 04:08:55.708462 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 30 04:08:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 04:08:55.718556 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-24b67f63-989d-42fe-a76d-7beb744b4fb4 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:55.735885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-24b67f63-989d-42fe-a76d-7beb744b4fb4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023140 Jun 30 04:08:55.736406 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 30 04:08:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:08:55.746047 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:55.760048 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017520 Jun 30 04:08:55.760567 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 30 04:08:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:08:55.769823 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-ce17e882-ddbd-4d64-a53d-bc77e6b8fd99 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:55.775904 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.wsgi [None req-ce17e882-ddbd-4d64-a53d-bc77e6b8fd99 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-ce17e882-ddbd-4d64-a53d-bc77e6b8fd99 admin admin] Request method failure captured: Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Accept: application/json Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Accept-Encoding: gzip, deflate Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Connection: keep-alive Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Content-Length: 0 Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Host: 10.222.0.13 Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Openstack-Api-Version: compute 2.90 Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Openstack-System-Scope: None Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: User-Agent: python-novaclient Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Auth-Token: gAAAAABivSHXKYuZZ7tq7AQRlh3JdKFMCrPDxmHSOPb0hQRxlKN5dtC7YuDX-o-K-0mo9cD6LwB8qlYBMgpQgV174mAGg-It3Iq_JGxgEWFBM-QcWPOvTQ8J-ZSSZ78HTB2Wnqv7V1Sv9YDZ1g7pd518mABpU3M20Qgt6qcp36YhKWXRACjCQkI Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Domain-Id: None Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Domain-Name: None Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Identity-Status: Confirmed Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Is-Admin-Project: True Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Domain-Id: default Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Domain-Name: Default Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Project-Name: admin Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Role: admin,reader,member Jun 30 04:08:55.777392 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Roles: admin,reader,member Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_447338b8480048d8be1a3dac45927add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/447338b8480048d8be1a3dac45927add"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/447338b8480048d8be1a3dac45927add"}]}] Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Tenant: admin Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Tenant-Id: 447338b8480048d8be1a3dac45927add Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-Tenant-Name: admin Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User: admin Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Domain-Id: default Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Domain-Name: Default Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Id: d70cac4e4add4da9a183025769b64cc8 Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: X-User-Name: admin Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: method: > Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: exception: Flavor 451 could not be found. Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: action_args: {'id': '451'} Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:08:55.778839 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:55.779885 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: ERROR nova.api.openstack.wsgi Jun 30 04:08:55.781248 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-ce17e882-ddbd-4d64-a53d-bc77e6b8fd99 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:08:55.782491 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-ce17e882-ddbd-4d64-a53d-bc77e6b8fd99 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012429 Jun 30 04:08:55.782491 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 30 04:08:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 04:08:56.618971 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:56.620019 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 30 04:08:56.620414 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:08:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:56.821675 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-4d26581c-ebb0-4159-9791-28219aea7fa9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:56.845356 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-4d26581c-ebb0-4159-9791-28219aea7fa9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.087076 Jun 30 04:08:56.845934 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 30 04:08:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:08:57.687085 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:57.688731 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002273 Jun 30 04:08:57.689359 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:08:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:57.888443 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-211fa811-0b75-4f8f-8553-57d87c9487bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:57.916907 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-211fa811-0b75-4f8f-8553-57d87c9487bc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.084414 Jun 30 04:08:57.917444 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 30 04:08:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 04:08:58.787306 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:58.788684 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 Jun 30 04:08:58.789079 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:08:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:08:58.991798 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-92d67b18-2fc8-4813-b4e3-86ea47af99a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:08:59.011720 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-92d67b18-2fc8-4813-b4e3-86ea47af99a1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.083374 Jun 30 04:08:59.012240 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 30 04:08:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:08:59.854215 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:08:59.855294 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 30 04:08:59.855686 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:09:00.059538 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-cf492a31-9bf9-4d25-a38a-3707edc361c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:09:00.079903 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-cf492a31-9bf9-4d25-a38a-3707edc361c1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.088421 Jun 30 04:09:00.080442 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 30 04:08:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:09:00.916062 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:09:00.917358 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Jun 30 04:09:00.917841 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:09:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:09:01.126948 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-076b8f4a-5217-4f48-8689-e71e530ef1f3 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:09:01.146873 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-076b8f4a-5217-4f48-8689-e71e530ef1f3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079410 Jun 30 04:09:01.147442 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Thu Jun 30 04:09:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:09:48.994081 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:09:48.995088 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-a0065fea-fc65-45b2-a97a-5efc27d543fc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 30 04:09:48.995531 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 30 04:09:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:09:49.006051 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:09:49.069110 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-2cae48fe-6ac5-48fc-b2f5-361da514580e admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:09:49.088575 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-2cae48fe-6ac5-48fc-b2f5-361da514580e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.086990 Jun 30 04:09:49.089122 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 30 04:09:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:09:49.114879 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-76499bfc-ea5a-40d1-8c0f-baa15ac8ca3c admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:09:49.120474 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG dbcounter [-] [103666] Writing DB stats nova_api:SELECT=14 {{(pid=103666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:09:49.129921 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-76499bfc-ea5a-40d1-8c0f-baa15ac8ca3c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020897 Jun 30 04:09:49.130704 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1282 bytes} [Thu Jun 30 04:09:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:09:49.142900 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-d2b05723-5fb2-491d-b694-d810201e265b admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:09:49.151316 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-d2b05723-5fb2-491d-b694-d810201e265b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012016 Jun 30 04:09:49.151842 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1285 bytes} [Thu Jun 30 04:09:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:09:49.163964 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-64c94e39-85b2-4e17-bfa5-51dcc2938ea9 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:09:49.172449 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-64c94e39-85b2-4e17-bfa5-51dcc2938ea9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012466 Jun 30 04:09:49.172980 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1285 bytes} [Thu Jun 30 04:09:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:09:49.184522 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-fc38016b-712d-453d-97b2-5d56279bfbdc admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:09:49.192348 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-fc38016b-712d-453d-97b2-5d56279bfbdc admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011416 Jun 30 04:09:49.192861 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1282 bytes} [Thu Jun 30 04:09:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:13:04.677849 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-64c94e39-85b2-4e17-bfa5-51dcc2938ea9 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:13:04.678864 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-64c94e39-85b2-4e17-bfa5-51dcc2938ea9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 30 04:13:04.679293 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:13:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:13:04.835067 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=6 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:13:04.972610 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-8d4e66dc-cbb3-43d8-8852-69da60509652 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:13:04.973883 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 04:13:04.973883 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jun 30 04:13:04.975084 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-8d4e66dc-cbb3-43d8-8852-69da60509652 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:13:04.975550 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-8d4e66dc-cbb3-43d8-8852-69da60509652 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:13:04.976350 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-8d4e66dc-cbb3-43d8-8852-69da60509652 admin admin] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:13:04.976799 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-8d4e66dc-cbb3-43d8-8852-69da60509652 admin admin] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:13:05.011254 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-8d4e66dc-cbb3-43d8-8852-69da60509652 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.177637 Jun 30 04:13:05.011814 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 35/70] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 30 04:13:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:13:05.862503 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-64c94e39-85b2-4e17-bfa5-51dcc2938ea9 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:13:05.863592 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-64c94e39-85b2-4e17-bfa5-51dcc2938ea9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jun 30 04:13:05.863985 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:13:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:13:06.074514 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-120bf56e-231c-4065-8aee-57b09b47f531 admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:13:06.075653 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 04:13:06.075653 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jun 30 04:13:06.076811 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-120bf56e-231c-4065-8aee-57b09b47f531 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:13:06.077238 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-120bf56e-231c-4065-8aee-57b09b47f531 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:13:06.078004 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-120bf56e-231c-4065-8aee-57b09b47f531 admin admin] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:13:06.078426 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-120bf56e-231c-4065-8aee-57b09b47f531 admin admin] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:13:06.098129 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-120bf56e-231c-4065-8aee-57b09b47f531 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.089622 Jun 30 04:13:06.098669 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 36/72] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 30 04:13:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:13:17.374943 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-64c94e39-85b2-4e17-bfa5-51dcc2938ea9 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:13:17.376317 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-64c94e39-85b2-4e17-bfa5-51dcc2938ea9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Jun 30 04:13:17.376830 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:13:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:13:17.532583 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell0:SELECT=4 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:13:17.533546 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_cell1:SELECT=4 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:13:17.534399 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG dbcounter [-] [103665] Writing DB stats nova_api:SELECT=8 {{(pid=103665) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:13:17.585951 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-1296a0af-db97-40c4-94ad-d3b01cf059ec admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:13:17.587141 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 04:13:17.587141 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jun 30 04:13:17.588318 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-1296a0af-db97-40c4-94ad-d3b01cf059ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:13:17.588756 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-1296a0af-db97-40c4-94ad-d3b01cf059ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:13:17.589527 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-1296a0af-db97-40c4-94ad-d3b01cf059ec admin admin] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:13:17.589946 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-1296a0af-db97-40c4-94ad-d3b01cf059ec admin admin] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:13:17.614483 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-1296a0af-db97-40c4-94ad-d3b01cf059ec admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089324 Jun 30 04:13:17.615170 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 37/74] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 30 04:13:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:13:18.457925 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: DEBUG nova.api.openstack.wsgi [None req-64c94e39-85b2-4e17-bfa5-51dcc2938ea9 admin admin] Calling method '>' {{(pid=103666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:13:18.458966 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: INFO nova.api.openstack.requestlog [None req-64c94e39-85b2-4e17-bfa5-51dcc2938ea9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 30 04:13:18.459504 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: [pid: 103666|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 30 04:13:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:13:18.653070 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG nova.api.openstack.wsgi [None req-43e8a271-1e17-490b-85b4-28f4cbb77a2d admin admin] Calling method '>' {{(pid=103665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:13:18.654231 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 04:13:18.654231 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: warnings.warn(msg) Jun 30 04:13:18.655447 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-43e8a271-1e17-490b-85b4-28f4cbb77a2d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:13:18.655879 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-43e8a271-1e17-490b-85b4-28f4cbb77a2d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:13:18.656706 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-43e8a271-1e17-490b-85b4-28f4cbb77a2d admin admin] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:13:18.657127 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: DEBUG oslo_concurrency.lockutils [None req-43e8a271-1e17-490b-85b4-28f4cbb77a2d admin admin] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103665) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:13:18.679251 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: INFO nova.api.openstack.requestlog [None req-43e8a271-1e17-490b-85b4-28f4cbb77a2d admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081271 Jun 30 04:13:18.679798 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: [pid: 103665|app: 0|req: 38/76] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 30 04:13:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:14:13.834833 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: Thu Jun 30 04:14:13 2022 - graceful shutdown triggered... Jun 30 04:14:13.835372 dv-cinder-846842-7-iscsi devstack@n-api.service[103665]: Gracefully killing worker 1 (pid: 103665)... Jun 30 04:14:13.834885 dv-cinder-846842-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 30 04:14:13.836552 dv-cinder-846842-7-iscsi devstack@n-api.service[103666]: Gracefully killing worker 2 (pid: 103666)... Jun 30 04:14:14.835579 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: worker 1 buried after 1 seconds Jun 30 04:14:14.835579 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: worker 2 buried after 1 seconds Jun 30 04:14:14.835579 dv-cinder-846842-7-iscsi devstack@n-api.service[103664]: goodbye to uWSGI. Jun 30 04:14:14.837966 dv-cinder-846842-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 30 04:14:14.838854 dv-cinder-846842-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 30 04:14:14.843129 dv-cinder-846842-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 04:14:14.854368 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 04:14:14 2022] *** Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: nodename: dv-cinder-846842-7-iscsi Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: machine: x86_64 Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: clock source: unix Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: pcre jit disabled Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: detected number of CPU cores: 4 Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: current working directory: / Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: detected binary path: /usr/bin/uwsgi-core Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: your processes number limit is 47680 Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: your memory page size is 4096 bytes Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: detected max file descriptor number: 2048 Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: lock engine: pthread robust mutexes Jun 30 04:14:14.857716 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: thunder lock: enabled Jun 30 04:14:14.858828 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 04:14:14.858828 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 04:14:14.904295 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: Python main interpreter initialized at 0x56012791c9c0 Jun 30 04:14:14.904295 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: python threads support enabled Jun 30 04:14:14.904295 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: your server socket listen backlog is limited to 100 connections Jun 30 04:14:14.904295 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: your mercy for graceful operations on workers is 90 seconds Jun 30 04:14:14.904779 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 04:14:14.904779 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: *** Operational MODE: preforking *** Jun 30 04:14:14.906375 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: *** uWSGI is running in multiple interpreter mode *** Jun 30 04:14:14.906375 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: spawned uWSGI master process (pid: 118173) Jun 30 04:14:14.906375 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: spawned uWSGI worker 1 (pid: 118187, cores: 1) Jun 30 04:14:14.906375 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: spawned uWSGI worker 2 (pid: 118188, cores: 1) Jun 30 04:14:14.906375 dv-cinder-846842-7-iscsi devstack@n-api.service[118173]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 04:14:14.905198 dv-cinder-846842-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 04:14:15.558874 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 04:14:15.559662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 04:14:16.759959 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 04:14:16.759959 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: from cryptography.utils import int_from_bytes Jun 30 04:14:16.760737 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 04:14:16.760737 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: from cryptography.utils import int_from_bytes Jun 30 04:14:16.786266 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 04:14:16.786266 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: from cryptography.utils import int_from_bytes Jun 30 04:14:16.786915 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 04:14:16.786915 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: from cryptography.utils import int_from_bytes Jun 30 04:14:19.136997 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 04:14:19.137611 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 04:14:19.137772 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 04:14:19.138137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 04:14:19.138417 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 04:14:19.138876 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.139240 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.139581 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.139904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.140236 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.140552 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.140881 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.141203 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.141518 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.141778 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.142098 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.142465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-7-iscsi {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.142809 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.143142 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.143482 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.143791 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.144101 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.144428 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.144747 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.145267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.146557 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.146557 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.146557 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.146820 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.147001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.147343 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.147677 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.147994 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.148331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.148647 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.149081 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-7-iscsi {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.149395 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.149713 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.150030 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.150461 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.150776 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.151114 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.151441 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.151765 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.152082 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.152433 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.155800 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.155800 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.155800 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.155800 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.155800 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.155800 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.155800 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.155800 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.156489 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.156489 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.156489 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.156489 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.156767 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.157100 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.157216 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.157397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.157710 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.158033 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.158349 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.161497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.161497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.161497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.161497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.161497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.161497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.161497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.161497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.162122 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.162122 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.162122 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.162122 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.162853 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.163080 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.165054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.165054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.165054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.165054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.165054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.165545 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.165545 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.165693 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.166033 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.166356 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.166697 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.167006 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.167289 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.167591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.167889 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.168212 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.168525 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.168838 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.169173 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.169464 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.169809 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.170536 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.170536 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.170853 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.171028 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.174162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.174162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.174162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.174162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.174162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.174162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.174162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.174162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.175445 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.175445 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.175445 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.175445 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.175445 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.176100 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.176100 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.176346 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.176668 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.176976 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.177290 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.177615 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.177920 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.178302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.178627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.178926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.179288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.179595 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.179906 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.180214 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.180520 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.181303 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.181303 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.182044 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.182044 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.182044 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.182420 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.182652 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.182965 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.183315 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.183659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.183996 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.184344 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.184663 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.185000 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.185372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.185946 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.186267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.186573 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.186906 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.187250 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.187570 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.187867 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.188234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.188511 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.188848 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.189183 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.189503 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.189823 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.190151 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.190471 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.191419 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.191419 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.191760 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.191918 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.192146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.195897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.196189 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.196501 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.196796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.197178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.197497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.197823 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.198141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.198449 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.198756 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.199117 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.199436 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.199751 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.200150 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.200721 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.201341 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.201892 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.202505 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.202966 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.203300 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.203645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.203960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.204285 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.204603 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.204919 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.205222 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.205542 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.205861 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.206171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.206504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.206819 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.207150 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.207484 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.207797 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.208106 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.208430 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.208767 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.209727 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.209727 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.209919 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.210117 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.210399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.210713 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.211056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.211421 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.211729 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.212059 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.212389 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.212712 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.213023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.213512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.214003 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.214516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.215642 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.215642 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.215642 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.216018 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.216420 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.216835 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.217152 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.217581 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.217906 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.218223 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.218537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.218850 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.219280 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.219616 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.219970 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.220317 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.220644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.220975 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.221291 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.221803 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.222362 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.222947 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.223516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.224028 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.224572 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.224988 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.225319 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.225640 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.225976 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.226297 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.226627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.227036 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.227663 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.228287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.228888 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.229370 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.229705 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.230025 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.230354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.230703 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.231319 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.231937 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.232518 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.233083 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.233362 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.233580 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.233901 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.234219 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.234533 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.234870 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.235362 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.235617 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.235864 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.236166 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.236480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.236796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.237125 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.237443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.237757 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.238073 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.238381 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.238693 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.239261 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.239589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.239909 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.240280 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.240622 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.240848 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.241155 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.241464 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.241771 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.242090 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.242421 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.242732 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.244372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.244372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.244372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.244372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.244862 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.244862 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.245036 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.245357 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.245634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.246010 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.246330 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.246637 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.246961 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.247317 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.247632 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.248291 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.248839 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.248839 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.249209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.249531 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.249843 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.250160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.250612 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.250894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.251140 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.251465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.251777 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.252096 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.252403 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.252700 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.253016 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.253339 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.253957 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.254246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.254566 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.254879 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 04:14:19.255378 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.255477 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 04:14:19.255618 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.255618 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.255797 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 04:14:19.255883 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.256039 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 04:14:19.256177 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.256276 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 04:14:19.256534 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.256662 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.256847 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.256987 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.257162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.257308 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.257470 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.257624 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.257778 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.257950 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.258093 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.258257 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.258403 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.258576 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.258711 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.258894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.259026 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.259244 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.259350 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.259503 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.259661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.259815 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.259968 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.260135 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-7-iscsi {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.260277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.260452 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.260599 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.260785 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.261005 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.261099 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.261190 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.261369 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.261469 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.261671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.261770 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.261988 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.262145 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.262303 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.262471 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.262683 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.262841 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.263040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.263392 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.263539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.263862 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.264242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.264334 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.264426 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.264426 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.264596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.264822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.264923 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.265023 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.265236 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.265328 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.265546 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.265644 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.265882 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.266047 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.266209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.266473 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.266756 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.266964 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.267056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.267163 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-7-iscsi {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.267280 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.267367 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.267573 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.267703 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.267814 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.267930 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.268053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.268313 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.268479 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.268614 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.268924 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.269230 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.269459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.269603 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.269815 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.269995 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.270114 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.270235 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.270477 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.270642 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.270774 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.271030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.271611 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.271758 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.271879 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.272028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.272143 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.272258 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.272258 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.272486 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.272602 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.272712 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.272826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.273037 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.273346 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.273533 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.273661 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.273774 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.273914 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.274037 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.274156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.274314 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.274440 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.274635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.274834 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.275074 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.275238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.275360 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.275470 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.275587 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.275703 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.275902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.276069 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.276208 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.276331 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.276487 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.276611 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.276815 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.276994 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.277116 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.277227 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.277414 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.277581 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.277712 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.277824 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.278013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.278181 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.278310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.278429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.278555 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.278666 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.278891 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.279059 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.279415 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.279644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.280153 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.280291 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.280404 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.280521 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.280630 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.280765 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.280881 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.281015 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.281231 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.281464 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.281464 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.281699 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.281816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.281934 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.282049 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.282165 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.282360 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.282558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.282678 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.282789 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.282978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.283183 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.283395 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.283516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.283626 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.283732 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.283927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.284367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.284520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.284709 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.284889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.285007 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.285243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.285361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.285694 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.285870 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.285997 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.286178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.286359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.286593 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.286778 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.286906 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.287032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.287265 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.287788 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.287918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.288029 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.288223 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.288392 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.288546 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.288788 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.288955 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.289070 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.289185 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.289299 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.289426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.289542 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.289663 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.289770 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.289995 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.290176 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.290294 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.290412 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.290551 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.290661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.290891 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.291071 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.291267 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.291496 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.291703 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.291820 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.291929 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.292155 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.292330 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.292466 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.292708 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.292830 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.293015 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.293271 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.293431 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.293629 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.293827 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.293973 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.294337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.294493 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.294689 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.294927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.295640 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.295809 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.295963 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.296113 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.296261 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.296425 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.296425 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.296846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.297011 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.297011 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.297287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.297426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.297426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.297784 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.297942 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.298091 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.298232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.298371 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.298516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.298665 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.298804 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.298944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.299104 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.299104 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.299406 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.299555 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.299555 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.299832 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.299987 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.300127 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.300267 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.300416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.300562 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.300702 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.300841 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.300987 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.301136 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.301284 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.301430 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.301698 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 04:14:19.301927 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.302072 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.302222 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.302369 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.302519 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.302519 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.302784 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.302924 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.303077 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.303243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.303407 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.303558 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.303699 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.303838 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.303991 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.304139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.304280 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.304428 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.304568 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.304720 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.304870 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.305009 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.305156 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.305296 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.305452 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.305626 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.305854 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.306007 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.306150 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.306298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.306439 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.306588 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.306728 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.306868 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.307015 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.307198 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.307356 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.307516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.307657 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.307856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.308010 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.308176 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.308336 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.308504 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.308743 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.308897 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.309065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.309306 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.309543 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.309791 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.310038 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.310293 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.310293 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.311208 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.311362 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.311513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.311680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.311930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.312166 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.312327 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.312540 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.312685 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.312857 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.313006 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.313154 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.313317 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.313457 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.313604 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.313760 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.313909 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.314058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.314207 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.314369 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.314524 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.314672 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.314822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.314962 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.315139 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.315297 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.315612 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.315757 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.315994 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.316150 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.316299 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.316447 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.316588 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.316729 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.316876 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.317034 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.317175 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.317323 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.317472 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.317612 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.317752 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.317901 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.318040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.318179 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.318317 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.318464 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.318612 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.318776 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.318917 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.319057 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.319222 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.319372 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.319530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.319670 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.320796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.320968 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.321116 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.321267 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.321421 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.321562 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.321714 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.321862 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.322096 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.322332 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.322488 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.322638 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.322779 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.322928 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.323077 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.323267 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.323424 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.323573 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.323714 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.323874 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.324124 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.324318 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.324470 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.324610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.324794 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.324943 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.325093 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.325252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.325392 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.325538 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.325686 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.325827 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.326078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.326743 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.326904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.327048 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.327236 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.327397 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.327547 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.327704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.327846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.327986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.327986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.328252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.328400 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.328555 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.328694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.328834 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.328834 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.329113 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.329269 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.329412 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.329553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.329553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.329921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.330266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.330266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.330850 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.331062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.331062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.331378 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.331521 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.331670 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.332043 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.332553 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.332867 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.333131 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.333365 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.333519 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.333662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.333814 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.334009 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.334158 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.334309 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.334458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.334601 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.334748 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.334888 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.335028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.335317 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.335517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.335661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.335809 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.335961 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.336100 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.336257 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.336499 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.336648 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.336797 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.336938 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.337092 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.337234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.337374 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.337521 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.337670 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.337826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.338001 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.338155 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.338296 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.338437 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.338584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.338734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.338883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.339023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.339185 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.339339 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.339481 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.339620 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.339913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.340037 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.340285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.340426 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.340625 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.340944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.341160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.341309 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.341457 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.341693 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.342991 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.343193 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.343354 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.343354 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.343648 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.343859 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.344056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.344187 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.344300 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.344417 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.344527 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.344634 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.344634 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.344634 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.344939 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.345055 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.345055 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.345417 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.345831 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.346008 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.346155 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.346296 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.346437 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.346695 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.346859 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.347009 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.347194 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.347340 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.347492 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.347633 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.347786 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.347936 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.348085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.348468 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.348708 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.348988 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.349149 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.349300 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.349442 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.349608 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.349874 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.350051 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.350226 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.350774 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.350928 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.351070 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.351248 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.351490 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.351490 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.351740 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.351859 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.352060 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.352331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.352503 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.352673 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.352831 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.353151 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.353334 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.353826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.353987 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.354139 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.354281 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.354429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.354571 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.354727 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.354880 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.355029 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.355193 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.355335 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.355490 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.355647 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.355795 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.355951 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.356093 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.356093 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.356446 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.356568 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.356695 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.356889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.357094 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.357094 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.361003 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.361177 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.361177 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.361473 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.361741 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.361913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.361913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.362204 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.362397 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.362652 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.362820 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.362820 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.363436 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.363597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.363740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.363965 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.364163 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.364321 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.364465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.364613 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.364762 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.364938 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.365317 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.365484 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.365641 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.365784 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.365933 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.366075 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.366215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.366461 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.366615 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.366735 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.366872 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.367111 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.367230 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.367530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.367678 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.367827 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.367968 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.368109 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.368265 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.368407 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.368407 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.368683 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.368832 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.368832 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.369118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.369260 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.369260 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.369538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.369679 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.369679 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.369679 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.370088 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.370230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.370370 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.370510 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.370711 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.370870 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.371011 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.371294 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.371294 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.371626 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.371776 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.371917 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.372095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.372095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.372095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.372095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.372095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.372829 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.374421 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.374740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.375018 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.375267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.375503 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.375503 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.375914 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.376137 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.376137 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.376490 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.376678 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.376829 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.377034 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.377655 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.377820 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.377991 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.378142 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.378291 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.378434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.378598 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.378830 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.378984 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.379292 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.379455 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.379577 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.379699 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.379809 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.379917 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.380026 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.380151 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.380420 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.380578 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.380729 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.380872 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.381012 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.381171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.381311 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.381451 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.381599 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.381599 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.381926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.381926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.382407 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.382875 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.383038 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.383038 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.383673 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.383841 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.383993 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.384169 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.384544 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.384724 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.384933 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.385121 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.385302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.385455 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.385770 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.385927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.385927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.386288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.386525 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.386641 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.386818 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.386949 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.389109 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.389718 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.389907 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.390084 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.390241 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.390402 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.390552 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.390701 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.390856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.391014 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.391197 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.391358 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.391507 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.391731 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.391960 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.392126 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.392285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.392448 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.392605 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.392605 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.392887 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.393110 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.393284 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.393452 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.393603 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.393760 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.393926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.395288 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.395487 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.395615 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.395726 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.395835 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.395951 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.396060 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.396060 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.396282 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.396393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.396723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.397126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.397393 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.397393 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.397915 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.398139 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.398305 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.398665 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.398931 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.399086 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.399619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.399851 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.400007 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.400286 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.400558 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.400833 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.401099 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.401099 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.401099 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.401955 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.402125 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.402283 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.402441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.402590 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.402590 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.402880 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.403061 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.404261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.405078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.405385 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.405385 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.405809 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.405809 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.406459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.406619 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.406769 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.406927 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.407085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.407277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.407472 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.407634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.407932 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.407932 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.408929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.409230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.409414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.409571 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.409720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.409884 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.410042 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.410211 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.410371 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.410531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.410700 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.410938 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.411212 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.411427 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.411427 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.411907 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.412066 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.412230 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.412230 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.412919 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.413031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.413148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.413266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.413389 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.413507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.413623 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.413733 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.413849 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.413968 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.414085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.414319 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.414480 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.414918 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.415074 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.415262 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.416015 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.416015 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.416335 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.416485 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.416632 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.416790 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.416948 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.417105 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.417309 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.417468 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.417594 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.417712 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.417926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.418088 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.418235 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.418382 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.418548 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.418763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.418916 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.419070 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.419393 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.422379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.422573 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.422819 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.422988 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.422988 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.423226 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.423481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.423649 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.423808 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.423956 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.424102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.424248 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.424405 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.424552 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.424707 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.424855 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.425001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.425147 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.425315 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.425463 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.425725 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.425910 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.426082 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.426082 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.426481 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.426639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.426789 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.426936 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.427083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.427288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.427452 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.427673 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.428042 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.428193 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.428357 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.428555 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.428772 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.428934 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.429120 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.429120 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.429538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.429538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.429851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.429851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.430162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.430476 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.430651 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.430861 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.431159 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.431326 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.431326 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.431678 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.431834 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.431996 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.432189 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.432377 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.432621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.432781 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.432973 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.433135 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.433285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.433431 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.433586 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.433786 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.433986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.433986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.434288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.434436 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.434582 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.434741 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.434741 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.435046 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.435255 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.435591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.436569 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.436731 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.436896 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.437046 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.437794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.437956 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.438105 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.438275 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.438436 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.438591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.438739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.438894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.438894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.439216 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.439367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.439540 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.439540 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.439928 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.440077 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.440237 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.440397 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.440545 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.440693 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.440847 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.441003 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.441160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.441160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.441448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.441448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.441746 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.441918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.442067 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.442233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.442388 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.442545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.442693 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.442892 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.443045 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.443249 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.443407 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.443407 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.443696 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.443696 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.443994 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.444195 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.444395 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.444395 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.444700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.444700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.444984 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.445139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.445296 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.445451 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.445451 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.445787 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.445787 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.446237 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.446765 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.447046 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.447253 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 04:14:19.447406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.447406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.447406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.447406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.447406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.447406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.447406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.447406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.448691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.448691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.448691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.448691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.448691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.448691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.448691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.448691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.449406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.449406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.449406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.449406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.449406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.449406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.449406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.449406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.450227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.450227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.450227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.450227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.450227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.450227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.450227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.450227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.451058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.451058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.451058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.451058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.451058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.451058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.451058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.451058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.452680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.452680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.452680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.452680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.452680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.452680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.452680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.452680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.453487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.453487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.453487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.453487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.453487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.453487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.453487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.453487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.454298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.454298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.454298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.454298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.454298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.454298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.454298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.454298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.455168 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.455168 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.455168 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.455168 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.455168 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.455168 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.455168 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.455168 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.456032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.456032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.456032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.456032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.456032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.456032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.456032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.456032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.458238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.458238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.458238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.458238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.458238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.458238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.458238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.458238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.459225 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.459225 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.459225 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.459225 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.459225 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.459225 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.459225 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.459225 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460951 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460951 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460951 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460951 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460951 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460951 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.460951 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.461651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.461651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.461651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.461651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.461651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.461651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.461651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.461651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.462458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.462458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.462458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.462458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.462458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.462458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.462458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.462458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.463921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.463921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.463921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.463921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.463921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.463921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.463921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.463921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.464726 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.464726 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.464726 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.464726 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.465132 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.465359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.465591 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.465909 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.467327 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.467327 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.467785 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.467911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.468211 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.468547 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.468868 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.469177 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.469501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.469805 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.470112 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.470430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.470752 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.471049 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.471377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.471686 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.471997 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.472300 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.472611 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.472912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.473240 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.473546 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.473850 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.474154 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.474480 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.474768 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.475077 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.475424 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.475744 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.475991 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.476295 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.476603 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.476989 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.477219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.477499 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.478428 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.478428 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.478428 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.478753 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.479016 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.479380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.479692 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.480012 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.480323 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.480636 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.480993 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.481311 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.481883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.482323 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.482727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.483250 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.483474 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.483786 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.484095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.484403 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.484727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.485038 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.485349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.485742 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.486251 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.486567 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.486878 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.487228 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.487539 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.487849 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.488159 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.488472 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.488780 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.489089 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.489468 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.489742 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.490060 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.490376 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.490728 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.491753 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.491753 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.491753 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.492112 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.492230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.492512 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.492839 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.493149 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.493264 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO dbcounter [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Registered counter for database nova_api Jun 30 04:14:19.493457 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.493962 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.494275 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.494592 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.494912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.495259 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.495576 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.495933 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.496198 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.497494 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.497494 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.497494 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.497494 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.498619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.498619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.499017 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.499017 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.499376 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.499688 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.500006 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.500315 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.500616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.500923 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.501230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.501531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.501833 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.502133 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.502432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.502735 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.503034 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.503361 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.503662 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.503962 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.504263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.504562 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.504865 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.505619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.505619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.505934 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.506278 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.506432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.506622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.506950 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.507900 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.508347 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.508554 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.508976 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.509296 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.509625 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.509951 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.510277 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.510590 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.510939 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.511271 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.511585 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.511898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.512342 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.512566 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.513309 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.514434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.514434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.514434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.518352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.518352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.518352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.518352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.518352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.518352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.518352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.518352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.520802 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.520802 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.520802 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.520802 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.521768 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_db.sqlalchemy.engines [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:14:19.522013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.522013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.522013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.522013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.522013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.522013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.522013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.522013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.523249 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.523249 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.523249 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.523249 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.523249 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 04:14:19.523249 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 04:14:19.525662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writer thread running {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:14:19.587468 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.context [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0b3dfcb-6461-41ce-bb34-7ec7929e49fb(cell1) {{(pid=118188) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 04:14:19.587767 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO dbcounter [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Registered counter for database nova_api Jun 30 04:14:19.592622 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:14:19.594245 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:14:19.595073 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:14:19.597297 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:14:19.599417 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO dbcounter [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Registered counter for database nova_cell0 Jun 30 04:14:19.604440 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO dbcounter [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Registered counter for database nova_cell1 Jun 30 04:14:19.609033 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_db.sqlalchemy.engines [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:14:19.613829 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_db.sqlalchemy.engines [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:14:19.616224 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_db.sqlalchemy.engines [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:14:19.619236 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writer thread running {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:14:19.620787 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writer thread running {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:14:19.627873 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writer thread running {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:14:19.678039 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.context [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f0b3dfcb-6461-41ce-bb34-7ec7929e49fb(cell1) {{(pid=118187) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 04:14:19.684505 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:14:19.687476 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:14:19.688780 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:14:19.691024 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:14:19.693126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO dbcounter [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Registered counter for database nova_cell0 Jun 30 04:14:19.697276 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO dbcounter [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Registered counter for database nova_cell1 Jun 30 04:14:19.704916 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_db.sqlalchemy.engines [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:14:19.706861 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_db.sqlalchemy.engines [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:14:19.718143 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writer thread running {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:14:19.719459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writer thread running {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:14:19.800673 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO dbcounter [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Registered counter for database nova_cell0 Jun 30 04:14:19.807999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_db.sqlalchemy.engines [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:14:19.813806 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writer thread running {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:14:19.882881 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO dbcounter [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Registered counter for database nova_cell0 Jun 30 04:14:19.890633 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_db.sqlalchemy.engines [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 04:14:19.895355 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writer thread running {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 04:14:20.167205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: WARNING keystonemiddleware.auth_token [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 04:14:20.175342 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: WARNING keystonemiddleware.auth_token [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 04:14:20.246176 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: WARNING keystonemiddleware.auth_token [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 04:14:20.254032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: WARNING keystonemiddleware.auth_token [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 04:14:20.532280 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: WARNING keystonemiddleware.auth_token [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 04:14:20.538700 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: WARNING keystonemiddleware.auth_token [None req-0ec7ddec-1bfe-4b0d-aafb-244d00dacddf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 04:14:20.544138 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56012791c9c0 pid: 118188 (default app) Jun 30 04:14:20.598009 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: WARNING keystonemiddleware.auth_token [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 04:14:20.604038 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: WARNING keystonemiddleware.auth_token [None req-edb52d3c-a181-422e-979b-4c11a55dadde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 04:14:20.609511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56012791c9c0 pid: 118187 (default app) Jun 30 04:15:00.746527 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:00.748286 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:00.749559 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:00.750559 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:01.805966 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-41fa5abf-ad9a-421f-8277-59c927c3ae04 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Action: 'create', calling method: .version_select at 0x7fb481965430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-232453982"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:04.284638 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-41fa5abf-ad9a-421f-8277-59c927c3ae04 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.553683 Jun 30 04:15:04.293850 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1154 bytes} [Thu Jun 30 04:15:00 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3564 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 04:15:04.631185 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cb2f78e8-2a62-4cd3-9b13-a42fe26a94e0 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb481a154c0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:04.660411 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:04.661982 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:04.662963 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:04.663879 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:06.108038 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1c2e6664-6da8-4e0d-9f43-a2479e72f998 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb481829310>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:06.281605 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1c2e6664-6da8-4e0d-9f43-a2479e72f998 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5f3cea07-7304-475a-8ee0-211d71c6dfe7" status: 200 len: 350 microversion: 2.1 time: 0.180992 Jun 30 04:15:06.282247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 2/2] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:15:06 2022] GET /compute/v2.1/os-volumes/5f3cea07-7304-475a-8ee0-211d71c6dfe7 => generated 350 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:15:06.529603 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cb2f78e8-2a62-4cd3-9b13-a42fe26a94e0 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091" status: 200 len: 345 microversion: 2.1 time: 2.233697 Jun 30 04:15:06.538160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 1/3] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:15:04 2022] GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 => generated 345 bytes in 2245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:15:06.562787 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-30548d8d-7abb-4b24-85d6-d76070612b05 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Action: 'create', calling method: .version_select at 0x7fb481829430>, body: {"snapshot": {"volume_id": "8fc69afc-1b71-422d-8df5-b031784d3091", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1550288557"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:07.591950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-30548d8d-7abb-4b24-85d6-d76070612b05 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.052831 Jun 30 04:15:07.594127 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 3/4] 10.222.0.13 () {60 vars in 1161 bytes} [Thu Jun 30 04:15:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:15:07.606288 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-788ae0f2-6503-4901-89f8-dc40ef7ddc3d tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb481816310>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:07.853676 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-788ae0f2-6503-4901-89f8-dc40ef7ddc3d tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d" status: 200 len: 287 microversion: 2.1 time: 0.252685 Jun 30 04:15:07.860815 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 2/5] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 30 04:15:07 2022] GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d => generated 287 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:07.865693 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a05d7547-d1f2-4bd8-a77f-9c3097e3015d tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb481829f70>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:08.254475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a05d7547-d1f2-4bd8-a77f-9c3097e3015d tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.393344 Jun 30 04:15:08.255551 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 4/6] 10.222.0.13 () {58 vars in 1139 bytes} [Thu Jun 30 04:15:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:15:08.268651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec35fb0e-18bc-41c7-9391-3b96e834acc5 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb4818164c0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:08.503075 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ec35fb0e-18bc-41c7-9391-3b96e834acc5 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d" status: 200 len: 287 microversion: 2.1 time: 0.239401 Jun 30 04:15:08.509045 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 3/7] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 30 04:15:08 2022] GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d => generated 287 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:09.008331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-686a15a1-e250-4c4c-9f67-4bbb8111ae59 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb481842ca0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:09.297187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-686a15a1-e250-4c4c-9f67-4bbb8111ae59 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8b7e648a-a10d-4b02-8bcd-8e5fd310da4c" status: 200 len: 350 microversion: 2.1 time: 0.293250 Jun 30 04:15:09.305872 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 5/8] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:15:09 2022] GET /compute/v2.1/os-volumes/8b7e648a-a10d-4b02-8bcd-8e5fd310da4c => generated 350 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:09.518321 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-71e6b459-9267-4ac3-9f98-c520265c9fd7 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb481816af0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:09.766733 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-71e6b459-9267-4ac3-9f98-c520265c9fd7 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d" status: 200 len: 287 microversion: 2.1 time: 0.254020 Jun 30 04:15:09.767699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 4/9] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 30 04:15:09 2022] GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d => generated 287 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:10.785537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6f552068-fa0f-4c66-8b2f-0ef6762c3d6f tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb481842790>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:10.850277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6f552068-fa0f-4c66-8b2f-0ef6762c3d6f tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d" status: 200 len: 287 microversion: 2.1 time: 0.074275 Jun 30 04:15:10.854658 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 6/10] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 30 04:15:10 2022] GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:11.869162 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fdce50bd-f95a-4e34-93a1-9c9b01a24b1a tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb4818321f0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:11.933747 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fdce50bd-f95a-4e34-93a1-9c9b01a24b1a tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d" status: 200 len: 288 microversion: 2.1 time: 0.074030 Jun 30 04:15:11.940755 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 5/11] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 30 04:15:11 2022] GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d => generated 288 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:11.947884 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bd33340f-53a1-4332-bb61-bc536d51c4ee tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb481842280>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:12.099375 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bd33340f-53a1-4332-bb61-bc536d51c4ee tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d" status: 202 len: 0 microversion: 2.1 time: 0.155703 Jun 30 04:15:12.100434 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 7/12] 10.222.0.13 () {58 vars in 1253 bytes} [Thu Jun 30 04:15:11 2022] DELETE /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:15:12.110785 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-45a28ce0-74c8-47ec-abe4-2887d2d546a4 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb481816d30>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:12.146228 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-45a28ce0-74c8-47ec-abe4-2887d2d546a4 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d" status: 200 len: 287 microversion: 2.1 time: 0.039349 Jun 30 04:15:12.146989 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 6/13] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 30 04:15:12 2022] GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:13.272785 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-48e25dfc-d078-4c27-aa2c-81b8241b5e6b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Action: 'create', calling method: .version_select at 0x7fb482212820>, body: {"keypair": {"name": "tempest-keypair-1702144774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSpwxp9e+P3WNM2+n2htsrlLB1tSd2VI7joRwbwqr5w9CtA0lRbvo+V9101zjUPzPgnWBe1RolRzGZaATShgG80brRRYF6YDMZ6aPaOXO+M4Q4zaRETNERYmeUbi35I2g=="}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:13.354436 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-48e25dfc-d078-4c27-aa2c-81b8241b5e6b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Getting quotas for project 71588f8a5fc34919a77f28b6a8c8db0e. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:15:13.364100 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-48e25dfc-d078-4c27-aa2c-81b8241b5e6b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Getting quotas for user 8e3bc7e015f5419aa956568707764f67 and project 71588f8a5fc34919a77f28b6a8c8db0e. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:15:13.382743 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1525005579", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "networks": [{"uuid": "ace93dd0-22f0-46a4-80c6-05197b7b7fb0"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:13.452716 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-48e25dfc-d078-4c27-aa2c-81b8241b5e6b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.458721 Jun 30 04:15:13.455779 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 8/14] 10.222.0.13 () {62 vars in 1199 bytes} [Thu Jun 30 04:15:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 463 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 30 04:15:13.470118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-58f5a377-84cc-4b13-ba6b-447b7fd5ff29 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb4817a6700>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:13.559788 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-58f5a377-84cc-4b13-ba6b-447b7fd5ff29 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d" status: 200 len: 287 microversion: 2.1 time: 0.097088 Jun 30 04:15:13.560852 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 9/15] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 30 04:15:13 2022] GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:13.607165 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] validate_networks() for [('ace93dd0-22f0-46a4-80c6-05197b7b7fb0', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:15:14.574763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-70582849-8f49-482a-969e-03b511701e12 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb4817a6dc0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:14.709426 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-70582849-8f49-482a-969e-03b511701e12 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d" status: 200 len: 287 microversion: 2.1 time: 0.138232 Jun 30 04:15:14.710669 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 10/16] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 30 04:15:14 2022] GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:15.028584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:15:15.029939 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:15:15.030650 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:15:15.034430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:15:15.035054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:15:15.071620 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:15.072588 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:15.073848 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:15.074485 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:15.145589 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Getting quotas for project 6a37f11a6f794a518cfcfa600caf2445. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:15:15.162200 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Getting quotas for user 392b8ea4f0c6480d9eb65ce93ec3e719 and project 6a37f11a6f794a518cfcfa600caf2445. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:15:15.187382 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:15:15.194374 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:15:15.528800 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6d127436-b537-478d-9c19-dedfca444d51 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.379659 Jun 30 04:15:15.546877 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 7/17] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:15:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:15:15.566591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5d1179a7-7e96-4cd3-a1d4-c1be80c29b49 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:15.570292 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5d1179a7-7e96-4cd3-a1d4-c1be80c29b49 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:15.635492 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a1ba9864-d117-41b3-b03b-a45c1b18b894 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb480f2fe50>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:15.956368 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5d1179a7-7e96-4cd3-a1d4-c1be80c29b49 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:15.964285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a1ba9864-d117-41b3-b03b-a45c1b18b894 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8dff65b0-31a9-401c-9cc0-1e989a3d50b2" status: 200 len: 350 microversion: 2.1 time: 0.344917 Jun 30 04:15:15.972537 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 8/18] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:15:15 2022] GET /compute/v2.1/os-volumes/8dff65b0-31a9-401c-9cc0-1e989a3d50b2 => generated 350 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:15.973308 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ab403dd8-a5e1-4f3f-aa1a-ef568bb6788e tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb480f4b5e0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:15.986106 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5d1179a7-7e96-4cd3-a1d4-c1be80c29b49 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1215 microversion: 2.1 time: 0.440187 Jun 30 04:15:15.995511 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 11/19] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:15 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1215 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:16.004000 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-2f87d7ec-e238-4118-bdbb-2e0a360ac9d3 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb480f8fc10>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:16.443794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-ab403dd8-a5e1-4f3f-aa1a-ef568bb6788e tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] HTTP exception thrown: Snapshot 7139fcc4-f28f-4e95-b962-83677d4c4a1d could not be found. Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ab403dd8-a5e1-4f3f-aa1a-ef568bb6788e tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Request method failure captured: Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d HTTP/1.1 Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSNEQ-R3ttPHrrZdIgBF0d_fb7NUeC_Sgc8Ej8M8kOU4XKybiOIibGd1bKom1QUqE_OBC30Otkj6ewXIiC4Bg1u0p6eKpLwOrRhKNWJI4i17lVEHDdJOo2brQTrk9QzNC4bLl0yisP--cHVWOda7_nC8A5odqHbbkDjaUCAzT-dT-H4 Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 1b2cfea312a04240a0a0e709879d4832 Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:15:16.449927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1b2cfea312a04240a0a0e709879d4832"}]}] Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 1b2cfea312a04240a0a0e709879d4832 Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesSnapshotsTestJSON-2006710545-project Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: ea7b896127b04912968d12a70b730884 Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2006710545-project Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Snapshot 7139fcc4-f28f-4e95-b962-83677d4c4a1d could not be found. Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '7139fcc4-f28f-4e95-b962-83677d4c4a1d'} Jun 30 04:15:16.451441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7139fcc4-f28f-4e95-b962-83677d4c4a1d could not be found. (HTTP 404) (Request-ID: req-87c1b9a4-a0d1-468b-ba4a-e0184aa44c6f) Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:16.452325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 04:15:16.453408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7139fcc4-f28f-4e95-b962-83677d4c4a1d could not be found. Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 30 04:15:16.454596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7139fcc4-f28f-4e95-b962-83677d4c4a1d could not be found. Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7139fcc4-f28f-4e95-b962-83677d4c4a1d could not be found. Jun 30 04:15:16.455851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:16.457306 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ab403dd8-a5e1-4f3f-aa1a-ef568bb6788e tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Returning 404 to user: Snapshot 7139fcc4-f28f-4e95-b962-83677d4c4a1d could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:15:16.458664 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ab403dd8-a5e1-4f3f-aa1a-ef568bb6788e tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d" status: 404 len: 111 microversion: 2.1 time: 0.489787 Jun 30 04:15:16.459563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 9/20] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 30 04:15:15 2022] GET /compute/v2.1/os-snapshots/7139fcc4-f28f-4e95-b962-83677d4c4a1d => generated 111 bytes in 492 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:15:16.476691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9438a6bc-8740-46f9-a7ad-f5ee7da211ed tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb4806a9310>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:16.600390 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-2f87d7ec-e238-4118-bdbb-2e0a360ac9d3 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.603992 Jun 30 04:15:16.601485 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 12/21] 10.222.0.13 () {58 vars in 1133 bytes} [Thu Jun 30 04:15:15 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:16.615248 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-283d2c5b-f8c9-436b-8731-7bd98ad1f02a tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb480f145e0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:16.932500 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9438a6bc-8740-46f9-a7ad-f5ee7da211ed tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091" status: 202 len: 0 microversion: 2.1 time: 0.465661 Jun 30 04:15:16.933198 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 10/22] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 30 04:15:16 2022] DELETE /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:15:16.947007 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1044882825", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17fe777c-5046-426d-94b6-3483df1f9f21"}], "security_groups": [{"name": "tempest-securitygroup--1106569760"}], "key_name": "tempest-keypair-1702144774", "user_data": "}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:17.128520 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-283d2c5b-f8c9-436b-8731-7bd98ad1f02a tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.517317 Jun 30 04:15:17.129879 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 13/23] 10.222.0.13 () {58 vars in 1148 bytes} [Thu Jun 30 04:15:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:15:17.135819 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bf1b3843-7a34-4d4f-ab0c-b92621390a22 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb480f8ff70>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:17.250958 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] validate_networks() for [('17fe777c-5046-426d-94b6-3483df1f9f21', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:15:17.289750 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bf1b3843-7a34-4d4f-ab0c-b92621390a22 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091" status: 200 len: 344 microversion: 2.1 time: 0.158597 Jun 30 04:15:17.291534 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 14/24] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:15:17 2022] GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:17.296947 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7b716062-f56a-4193-97f5-f7ab7ebb3811 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:17.297149 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7b716062-f56a-4193-97f5-f7ab7ebb3811 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:17.481213 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7b716062-f56a-4193-97f5-f7ab7ebb3811 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:17.501157 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7b716062-f56a-4193-97f5-f7ab7ebb3811 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1215 microversion: 2.1 time: 0.206397 Jun 30 04:15:17.501786 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 15/25] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:17 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:17.524806 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cd01eae6-4484-4439-8311-5ebe0d8da627 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb480f14040>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:17.758583 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cd01eae6-4484-4439-8311-5ebe0d8da627 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.247341 Jun 30 04:15:17.759779 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 16/26] 10.222.0.13 () {58 vars in 1133 bytes} [Thu Jun 30 04:15:17 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:17.770902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-dc50e0a0-c502-47ff-b86f-676a1fd62448 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb4817cb160>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:18.127074 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-dc50e0a0-c502-47ff-b86f-676a1fd62448 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.359746 Jun 30 04:15:18.128046 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 17/27] 10.222.0.13 () {58 vars in 1166 bytes} [Thu Jun 30 04:15:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:15:18.153582 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-57614f32-a26d-4341-8cb2-8975275166a3 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb480f1e430>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:18.181966 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:15:18.182439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:15:18.182902 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:15:18.183413 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:15:18.184084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:15:18.208345 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:18.210448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:18.211444 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:18.211878 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:18.280222 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Getting quotas for project 71588f8a5fc34919a77f28b6a8c8db0e. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:15:18.292497 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Getting quotas for user 8e3bc7e015f5419aa956568707764f67 and project 71588f8a5fc34919a77f28b6a8c8db0e. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:15:18.315333 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-57614f32-a26d-4341-8cb2-8975275166a3 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.178360 Jun 30 04:15:18.316116 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 18/28] 10.222.0.13 () {58 vars in 1169 bytes} [Thu Jun 30 04:15:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:18.323648 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:15:18.323648 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:15:18.329085 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f8a9237e-7ae0-49e2-85d4-1849234f769f tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb480f8faf0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:18.393477 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bf6d8c00-4612-4dba-a615-0d7c366a0947 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.454388 Jun 30 04:15:18.394137 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 11/29] 10.222.0.13 () {62 vars in 1187 bytes} [Thu Jun 30 04:15:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 04:15:18.404421 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7223bfdc-2d69-4007-94bc-48a87f4c3270 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb4806a9f70>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:18.410236 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f8a9237e-7ae0-49e2-85d4-1849234f769f tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091" status: 200 len: 344 microversion: 2.1 time: 0.085096 Jun 30 04:15:18.411477 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 19/30] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:15:18 2022] GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:18.416216 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-498ec19b-0e57-4101-9c31-f1d476944a13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:18.416885 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-498ec19b-0e57-4101-9c31-f1d476944a13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:18.527357 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-498ec19b-0e57-4101-9c31-f1d476944a13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:18.540043 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7223bfdc-2d69-4007-94bc-48a87f4c3270 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.139434 Jun 30 04:15:18.540783 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 12/31] 10.222.0.13 () {58 vars in 1154 bytes} [Thu Jun 30 04:15:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:18.552675 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dc5bd81b-ec3a-40f5-be4d-ca5a7b355e5e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:18.553261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dc5bd81b-ec3a-40f5-be4d-ca5a7b355e5e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:18.560728 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-498ec19b-0e57-4101-9c31-f1d476944a13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:18.562261 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-498ec19b-0e57-4101-9c31-f1d476944a13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:18.568906 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-498ec19b-0e57-4101-9c31-f1d476944a13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1282 microversion: 2.20 time: 0.156361 Jun 30 04:15:18.577451 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc5bd81b-ec3a-40f5-be4d-ca5a7b355e5e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:18.578309 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc5bd81b-ec3a-40f5-be4d-ca5a7b355e5e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:18.579356 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc5bd81b-ec3a-40f5-be4d-ca5a7b355e5e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:18.580033 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc5bd81b-ec3a-40f5-be4d-ca5a7b355e5e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:18.580634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 20/32] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:18 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:18.593028 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ee88cdaa-d3ea-48dd-840f-13e147fc21c9 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb480f8faf0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:18.787538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ee88cdaa-d3ea-48dd-840f-13e147fc21c9 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.205331 Jun 30 04:15:18.788343 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 21/33] 10.222.0.13 () {58 vars in 1187 bytes} [Thu Jun 30 04:15:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:18.801176 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b00b67f8-a939-4315-a8ce-b4b9a8e52bc2 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] Calling method '.version_select at 0x7fb480f14e50>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:18.812277 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dc5bd81b-ec3a-40f5-be4d-ca5a7b355e5e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:18.835298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dc5bd81b-ec3a-40f5-be4d-ca5a7b355e5e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1219 microversion: 2.1 time: 0.292855 Jun 30 04:15:18.836501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 13/34] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:18 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1219 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:18.939254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b00b67f8-a939-4315-a8ce-b4b9a8e52bc2 tempest-VolumesTestJSON-2013227690 tempest-VolumesTestJSON-2013227690-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.142891 Jun 30 04:15:18.939853 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 22/35] 10.222.0.13 () {58 vars in 1154 bytes} [Thu Jun 30 04:15:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:15:19.422835 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b3e9e87f-3988-4448-b569-c5aefea13675 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb480627d30>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:19.554039 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b3e9e87f-3988-4448-b569-c5aefea13675 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091" status: 200 len: 344 microversion: 2.1 time: 0.135039 Jun 30 04:15:19.555143 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 14/36] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:15:19 2022] GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:19.590853 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d15600bf-b3c1-4ca7-854f-067b2b57f94d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:19.591577 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d15600bf-b3c1-4ca7-854f-067b2b57f94d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:19.726078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d15600bf-b3c1-4ca7-854f-067b2b57f94d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:19.734555 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d15600bf-b3c1-4ca7-854f-067b2b57f94d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:19.736129 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d15600bf-b3c1-4ca7-854f-067b2b57f94d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:19.737244 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d15600bf-b3c1-4ca7-854f-067b2b57f94d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1282 microversion: 2.20 time: 0.153589 Jun 30 04:15:19.738444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 23/37] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:19 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:19.854046 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d5473054-f16f-474d-8674-2a7e88acde11 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:19.854727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d5473054-f16f-474d-8674-2a7e88acde11 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:19.866328 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d5473054-f16f-474d-8674-2a7e88acde11 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:19.867183 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d5473054-f16f-474d-8674-2a7e88acde11 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:19.868160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d5473054-f16f-474d-8674-2a7e88acde11 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:19.869768 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d5473054-f16f-474d-8674-2a7e88acde11 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:19.989283 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d5473054-f16f-474d-8674-2a7e88acde11 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:20.002221 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d5473054-f16f-474d-8674-2a7e88acde11 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1267 microversion: 2.1 time: 0.153275 Jun 30 04:15:20.003183 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 15/38] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:19 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:20.570397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-35e96d5e-350d-42f2-9e05-8720217de2f8 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb480f145e0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:20.624972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-35e96d5e-350d-42f2-9e05-8720217de2f8 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] HTTP exception thrown: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-35e96d5e-350d-42f2-9e05-8720217de2f8 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Request method failure captured: Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 HTTP/1.1 Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSNEQ-R3ttPHrrZdIgBF0d_fb7NUeC_Sgc8Ej8M8kOU4XKybiOIibGd1bKom1QUqE_OBC30Otkj6ewXIiC4Bg1u0p6eKpLwOrRhKNWJI4i17lVEHDdJOo2brQTrk9QzNC4bLl0yisP--cHVWOda7_nC8A5odqHbbkDjaUCAzT-dT-H4 Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 1b2cfea312a04240a0a0e709879d4832 Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:15:20.629095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1b2cfea312a04240a0a0e709879d4832"}]}] Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 1b2cfea312a04240a0a0e709879d4832 Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-VolumesSnapshotsTestJSON-2006710545-project Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: ea7b896127b04912968d12a70b730884 Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2006710545-project Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '8fc69afc-1b71-422d-8df5-b031784d3091'} Jun 30 04:15:20.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. (HTTP 404) (Request-ID: req-d72e41cf-2295-4717-a50e-332034344799) Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:20.631247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 04:15:20.632215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 04:15:20.633137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.634228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.635897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-35e96d5e-350d-42f2-9e05-8720217de2f8 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Returning 404 to user: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:15:20.636753 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-35e96d5e-350d-42f2-9e05-8720217de2f8 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091" status: 404 len: 109 microversion: 2.1 time: 0.071122 Jun 30 04:15:20.637308 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 24/39] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:15:20 2022] GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:15:20.649404 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1ac6628f-35f4-4f64-abb4-671f011c50e4 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb48060ca60>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:20.693567 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-1ac6628f-35f4-4f64-abb4-671f011c50e4 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] HTTP exception thrown: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1ac6628f-35f4-4f64-abb4-671f011c50e4 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Request method failure captured: Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 HTTP/1.1 Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSNEQ-R3ttPHrrZdIgBF0d_fb7NUeC_Sgc8Ej8M8kOU4XKybiOIibGd1bKom1QUqE_OBC30Otkj6ewXIiC4Bg1u0p6eKpLwOrRhKNWJI4i17lVEHDdJOo2brQTrk9QzNC4bLl0yisP--cHVWOda7_nC8A5odqHbbkDjaUCAzT-dT-H4 Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 1b2cfea312a04240a0a0e709879d4832 Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:15:20.696341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1b2cfea312a04240a0a0e709879d4832"}]}] Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 1b2cfea312a04240a0a0e709879d4832 Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesSnapshotsTestJSON-2006710545-project Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: ea7b896127b04912968d12a70b730884 Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2006710545-project Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '8fc69afc-1b71-422d-8df5-b031784d3091'} Jun 30 04:15:20.697390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. (HTTP 404) (Request-ID: req-74641b6e-c81f-432d-ad44-d69ab00abe30) Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:20.698377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 04:15:20.699426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 04:15:20.701405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1ac6628f-35f4-4f64-abb4-671f011c50e4 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Returning 404 to user: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:15:20.703152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1ac6628f-35f4-4f64-abb4-671f011c50e4 tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091" status: 404 len: 109 microversion: 2.1 time: 0.053683 Jun 30 04:15:20.708853 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3272b6c7-b60d-42a9-95c4-ba002538bc9a tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Calling method '.version_select at 0x7fb4817cbaf0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:20.710781 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 16/40] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 30 04:15:20 2022] DELETE /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:15:20.742754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-3272b6c7-b60d-42a9-95c4-ba002538bc9a tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] HTTP exception thrown: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3272b6c7-b60d-42a9-95c4-ba002538bc9a tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Request method failure captured: Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 HTTP/1.1 Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSNEQ-R3ttPHrrZdIgBF0d_fb7NUeC_Sgc8Ej8M8kOU4XKybiOIibGd1bKom1QUqE_OBC30Otkj6ewXIiC4Bg1u0p6eKpLwOrRhKNWJI4i17lVEHDdJOo2brQTrk9QzNC4bLl0yisP--cHVWOda7_nC8A5odqHbbkDjaUCAzT-dT-H4 Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 1b2cfea312a04240a0a0e709879d4832 Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:15:20.745944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1b2cfea312a04240a0a0e709879d4832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1b2cfea312a04240a0a0e709879d4832"}]}] Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 1b2cfea312a04240a0a0e709879d4832 Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2006710545 Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-VolumesSnapshotsTestJSON-2006710545-project Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: ea7b896127b04912968d12a70b730884 Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2006710545-project Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '8fc69afc-1b71-422d-8df5-b031784d3091'} Jun 30 04:15:20.747062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. (HTTP 404) (Request-ID: req-cd669f91-c250-4c73-8e48-205999fee8d9) Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:20.747915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 04:15:20.751027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 04:15:20.752650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3272b6c7-b60d-42a9-95c4-ba002538bc9a tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] Returning 404 to user: Volume 8fc69afc-1b71-422d-8df5-b031784d3091 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3272b6c7-b60d-42a9-95c4-ba002538bc9a tempest-VolumesSnapshotsTestJSON-2006710545 tempest-VolumesSnapshotsTestJSON-2006710545-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091" status: 404 len: 109 microversion: 2.1 time: 0.044211 Jun 30 04:15:20.754893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 25/41] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:15:20 2022] GET /compute/v2.1/os-volumes/8fc69afc-1b71-422d-8df5-b031784d3091 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 04:15:20.758976 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9ad61df5-3e58-4532-b187-f37979adb359 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:20.759656 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9ad61df5-3e58-4532-b187-f37979adb359 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:20.785515 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9ad61df5-3e58-4532-b187-f37979adb359 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:20.786842 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9ad61df5-3e58-4532-b187-f37979adb359 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:20.788448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9ad61df5-3e58-4532-b187-f37979adb359 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:20.789025 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9ad61df5-3e58-4532-b187-f37979adb359 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:20.951661 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9ad61df5-3e58-4532-b187-f37979adb359 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:20.973781 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9ad61df5-3e58-4532-b187-f37979adb359 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:20.979913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9ad61df5-3e58-4532-b187-f37979adb359 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:20.983893 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9ad61df5-3e58-4532-b187-f37979adb359 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1334 microversion: 2.20 time: 0.231128 Jun 30 04:15:20.985444 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 17/42] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:20 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1334 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:15:21.022298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e5a35a52-3de3-497a-8003-8b74899c1f82 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:21.023798 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e5a35a52-3de3-497a-8003-8b74899c1f82 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:21.050878 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e5a35a52-3de3-497a-8003-8b74899c1f82 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:21.051672 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e5a35a52-3de3-497a-8003-8b74899c1f82 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:21.053634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e5a35a52-3de3-497a-8003-8b74899c1f82 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:21.056687 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e5a35a52-3de3-497a-8003-8b74899c1f82 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:21.608397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e5a35a52-3de3-497a-8003-8b74899c1f82 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:21.641386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e5a35a52-3de3-497a-8003-8b74899c1f82 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1273 microversion: 2.1 time: 0.619468 Jun 30 04:15:21.644420 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 26/43] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:21 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1273 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:15:22.016539 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3ecae841-9549-47ce-841b-c6e6bde77fa6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:22.017439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3ecae841-9549-47ce-841b-c6e6bde77fa6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:22.033599 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ecae841-9549-47ce-841b-c6e6bde77fa6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:22.034222 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ecae841-9549-47ce-841b-c6e6bde77fa6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:22.036621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ecae841-9549-47ce-841b-c6e6bde77fa6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:22.040546 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ecae841-9549-47ce-841b-c6e6bde77fa6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:22.667005 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-827c593e-efda-4bb3-a1d1-47403d6aec5f tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:22.667755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-827c593e-efda-4bb3-a1d1-47403d6aec5f tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:22.678589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-827c593e-efda-4bb3-a1d1-47403d6aec5f tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:22.682182 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-827c593e-efda-4bb3-a1d1-47403d6aec5f tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:22.683126 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-827c593e-efda-4bb3-a1d1-47403d6aec5f tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:22.683661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-827c593e-efda-4bb3-a1d1-47403d6aec5f tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:22.869746 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3ecae841-9549-47ce-841b-c6e6bde77fa6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:22.884402 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3ecae841-9549-47ce-841b-c6e6bde77fa6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:22.893061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3ecae841-9549-47ce-841b-c6e6bde77fa6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:22.899619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3ecae841-9549-47ce-841b-c6e6bde77fa6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1340 microversion: 2.20 time: 0.891045 Jun 30 04:15:22.902817 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 18/44] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:22 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1340 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:23.002761 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-827c593e-efda-4bb3-a1d1-47403d6aec5f tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:23.016296 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-827c593e-efda-4bb3-a1d1-47403d6aec5f tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1273 microversion: 2.1 time: 0.354044 Jun 30 04:15:23.018229 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 27/45] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:22 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1273 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:15:23.922906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-55fa91a7-f3c0-4733-bcfc-ff9a5634c411 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:23.923674 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-55fa91a7-f3c0-4733-bcfc-ff9a5634c411 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:23.940948 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55fa91a7-f3c0-4733-bcfc-ff9a5634c411 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:23.943577 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55fa91a7-f3c0-4733-bcfc-ff9a5634c411 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:23.946853 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55fa91a7-f3c0-4733-bcfc-ff9a5634c411 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:23.950204 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55fa91a7-f3c0-4733-bcfc-ff9a5634c411 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:24.040941 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e7491947-edfa-452b-a15f-e1443606cef0 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:24.041726 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e7491947-edfa-452b-a15f-e1443606cef0 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:24.056268 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e7491947-edfa-452b-a15f-e1443606cef0 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:24.076554 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e7491947-edfa-452b-a15f-e1443606cef0 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:24.080188 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e7491947-edfa-452b-a15f-e1443606cef0 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:24.088348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e7491947-edfa-452b-a15f-e1443606cef0 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:24.874824 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55fa91a7-f3c0-4733-bcfc-ff9a5634c411 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:24.893635 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55fa91a7-f3c0-4733-bcfc-ff9a5634c411 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:24.905525 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55fa91a7-f3c0-4733-bcfc-ff9a5634c411 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:24.906471 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-55fa91a7-f3c0-4733-bcfc-ff9a5634c411 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.988423 Jun 30 04:15:24.907275 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 19/46] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:23 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:25.210930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e7491947-edfa-452b-a15f-e1443606cef0 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:25.219875 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e7491947-edfa-452b-a15f-e1443606cef0 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 1.184670 Jun 30 04:15:25.223728 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 28/47] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:24 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:15:25.925977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3ea07e92-8289-4a67-8b9a-585c818637af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:25.926659 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3ea07e92-8289-4a67-8b9a-585c818637af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:25.949377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ea07e92-8289-4a67-8b9a-585c818637af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:25.950453 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ea07e92-8289-4a67-8b9a-585c818637af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:25.952273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ea07e92-8289-4a67-8b9a-585c818637af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:25.952739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ea07e92-8289-4a67-8b9a-585c818637af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:26.239938 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5b86e8a6-7598-41ac-b09e-7f6f7f80be88 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:26.241445 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5b86e8a6-7598-41ac-b09e-7f6f7f80be88 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:26.252032 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5b86e8a6-7598-41ac-b09e-7f6f7f80be88 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:26.252486 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5b86e8a6-7598-41ac-b09e-7f6f7f80be88 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:26.253268 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5b86e8a6-7598-41ac-b09e-7f6f7f80be88 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:26.256715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5b86e8a6-7598-41ac-b09e-7f6f7f80be88 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:26.865047 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3ea07e92-8289-4a67-8b9a-585c818637af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:26.875133 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3ea07e92-8289-4a67-8b9a-585c818637af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:26.881568 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3ea07e92-8289-4a67-8b9a-585c818637af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:26.890941 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3ea07e92-8289-4a67-8b9a-585c818637af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.968792 Jun 30 04:15:26.904617 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 20/48] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:25 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:26.912153 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5b86e8a6-7598-41ac-b09e-7f6f7f80be88 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:26.920301 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5b86e8a6-7598-41ac-b09e-7f6f7f80be88 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.684115 Jun 30 04:15:26.920894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 29/49] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:26 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:27.743927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b861edf4-8b89-4d4e-a57b-90a295522f76 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Action: 'create', calling method: .version_select at 0x7fb4805b01f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1137776831", "metadata": {"Type": "work"}}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b861edf4-8b89-4d4e-a57b-90a295522f76 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Request method failure captured: Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 122 Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSNed-zGoWXvYCaffpqlTgsZgYQ_lV0E0cjfe_AVvUfIawZNzT_vs0cejzxd2AQwpPplvy9DjFkaevIFECZ9tNuH7EiD4uHIriEnMOtQXvfLSv8fw9IDqjZdHN0JOjGTpxYnZR1RnfvCInETJJSSAxrfna5xwxG4pvOAg54c0sLAYT4 Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:15:27.784232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f3525c22b215472ca04b6cd2a7e76f84"}]}] Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: bc92263566814e9b98d611d0c03f5e81 Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1137776831", "metadata": {"Type": "work"}}} Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: Jun 30 04:15:27.786263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1137776831', 'metadata': {'Type': 'work'}}}} Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise error Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi '#$%' Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:15:27.787178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 04:15:27.788640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 04:15:27.789894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 04:15:27.789894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.789894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b861edf4-8b89-4d4e-a57b-90a295522f76 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:15:27.789894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b861edf4-8b89-4d4e-a57b-90a295522f76 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.878370 Jun 30 04:15:27.789894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 21/50] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 30 04:15:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 884 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 04:15:27.804446 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-33696c4e-33de-4246-85e1-5a68ba7d4f2e tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Action: 'create', calling method: .version_select at 0x7fb480e898b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-703403828", "metadata": {"Type": "work"}}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-33696c4e-33de-4246-85e1-5a68ba7d4f2e tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Request method failure captured: Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 119 Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSNed-zGoWXvYCaffpqlTgsZgYQ_lV0E0cjfe_AVvUfIawZNzT_vs0cejzxd2AQwpPplvy9DjFkaevIFECZ9tNuH7EiD4uHIriEnMOtQXvfLSv8fw9IDqjZdHN0JOjGTpxYnZR1RnfvCInETJJSSAxrfna5xwxG4pvOAg54c0sLAYT4 Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:15:27.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f3525c22b215472ca04b6cd2a7e76f84"}]}] Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: bc92263566814e9b98d611d0c03f5e81 Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-703403828", "metadata": {"Type": "work"}}} Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: Jun 30 04:15:27.822102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-703403828', 'metadata': {'Type': 'work'}}}} Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise error Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi '0' Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:15:27.822953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 04:15:27.824645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 04:15:27.826651 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 04:15:27.826651 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.826651 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-33696c4e-33de-4246-85e1-5a68ba7d4f2e tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:15:27.827578 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-33696c4e-33de-4246-85e1-5a68ba7d4f2e tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028292 Jun 30 04:15:27.828583 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 30/51] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 30 04:15:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 04:15:27.840805 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-20755436-396c-40cf-9593-a13ac7cc8f09 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Action: 'create', calling method: .version_select at 0x7fb48060cc10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-761802207", "metadata": {"Type": "work"}}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-20755436-396c-40cf-9593-a13ac7cc8f09 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Request method failure captured: Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 118 Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSNed-zGoWXvYCaffpqlTgsZgYQ_lV0E0cjfe_AVvUfIawZNzT_vs0cejzxd2AQwpPplvy9DjFkaevIFECZ9tNuH7EiD4uHIriEnMOtQXvfLSv8fw9IDqjZdHN0JOjGTpxYnZR1RnfvCInETJJSSAxrfna5xwxG4pvOAg54c0sLAYT4 Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:15:27.843639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f3525c22b215472ca04b6cd2a7e76f84"}]}] Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: bc92263566814e9b98d611d0c03f5e81 Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-761802207", "metadata": {"Type": "work"}}} Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: Jun 30 04:15:27.844979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-761802207', 'metadata': {'Type': 'work'}}}} Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise error Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi '' Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:15:27.845803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 04:15:27.847273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 04:15:27.848767 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 04:15:27.848767 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.849800 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-20755436-396c-40cf-9593-a13ac7cc8f09 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:15:27.851210 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-20755436-396c-40cf-9593-a13ac7cc8f09 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015854 Jun 30 04:15:27.852925 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 22/52] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 30 04:15:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 04:15:27.863711 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9b1c8a86-d335-4673-a85e-7498b0dbae31 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Calling method '.version_select at 0x7fb480e4e310>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:27.912776 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8b381a62-b185-44f0-97ed-25bece9d5835 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:27.914065 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8b381a62-b185-44f0-97ed-25bece9d5835 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:27.917009 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-9b1c8a86-d335-4673-a85e-7498b0dbae31 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] HTTP exception thrown: Volume tempest-invalid-261600739 could not be found. Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9b1c8a86-d335-4673-a85e-7498b0dbae31 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Request method failure captured: Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-261600739 HTTP/1.1 Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSNed-zGoWXvYCaffpqlTgsZgYQ_lV0E0cjfe_AVvUfIawZNzT_vs0cejzxd2AQwpPplvy9DjFkaevIFECZ9tNuH7EiD4uHIriEnMOtQXvfLSv8fw9IDqjZdHN0JOjGTpxYnZR1RnfvCInETJJSSAxrfna5xwxG4pvOAg54c0sLAYT4 Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:15:27.919475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f3525c22b215472ca04b6cd2a7e76f84"}]}] Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: bc92263566814e9b98d611d0c03f5e81 Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Volume tempest-invalid-261600739 could not be found. Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': 'tempest-invalid-261600739'} Jun 30 04:15:27.921187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-261600739 could not be found. (HTTP 404) (Request-ID: req-e5141a02-a15a-498a-9dc7-87ffcb61060b) Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:27.922031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 04:15:27.927266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-261600739 could not be found. Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:15:27.928458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-261600739 could not be found. Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-261600739 could not be found. Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9b1c8a86-d335-4673-a85e-7498b0dbae31 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Returning 404 to user: Volume tempest-invalid-261600739 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9b1c8a86-d335-4673-a85e-7498b0dbae31 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-261600739" status: 404 len: 98 microversion: 2.1 time: 0.063640 Jun 30 04:15:27.929723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 31/53] 10.222.0.13 () {58 vars in 1214 bytes} [Thu Jun 30 04:15:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-261600739 => generated 98 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 30 04:15:27.937203 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0d916287-c5b1-4533-a7c1-4b6efc8a5489 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005649 Jun 30 04:15:27.937889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b381a62-b185-44f0-97ed-25bece9d5835 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:27.942200 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b381a62-b185-44f0-97ed-25bece9d5835 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:27.942314 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 32/54] 10.222.0.13 () {58 vars in 1139 bytes} [Thu Jun 30 04:15:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 04:15:27.942402 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b381a62-b185-44f0-97ed-25bece9d5835 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:27.942402 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b381a62-b185-44f0-97ed-25bece9d5835 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:27.950593 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-aee50665-a902-459b-b15f-c55c27152fc1 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:27.951894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-aee50665-a902-459b-b15f-c55c27152fc1 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:27.968766 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aee50665-a902-459b-b15f-c55c27152fc1 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:27.971424 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aee50665-a902-459b-b15f-c55c27152fc1 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:27.972492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aee50665-a902-459b-b15f-c55c27152fc1 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:27.973028 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aee50665-a902-459b-b15f-c55c27152fc1 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:28.238875 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=4 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:28.305912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=12 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:28.846891 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8b381a62-b185-44f0-97ed-25bece9d5835 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:28.878759 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-aee50665-a902-459b-b15f-c55c27152fc1 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:28.880547 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8b381a62-b185-44f0-97ed-25bece9d5835 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:28.894730 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-aee50665-a902-459b-b15f-c55c27152fc1 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.951227 Jun 30 04:15:28.900661 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8b381a62-b185-44f0-97ed-25bece9d5835 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:28.908763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 33/55] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:27 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:28.909702 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8b381a62-b185-44f0-97ed-25bece9d5835 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 1.002959 Jun 30 04:15:28.912515 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 23/56] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:27 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:28.916735 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-eb6445ac-3f79-49b2-b044-1325bd137e0d tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006594 Jun 30 04:15:28.917275 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 34/57] 10.222.0.13 () {58 vars in 1136 bytes} [Thu Jun 30 04:15:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 04:15:29.397390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-a5984caf-5bbc-4a73-b46d-58e7ea849d3f req-b7d7e066-b7fc-4ded-b1d5-5ff14dcdf9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3f3442-a00e-47ee-b0df-f099086628ce", "tag": "bd404336-185f-4a39-8576-5211044a2340"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:29.427059 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-a5984caf-5bbc-4a73-b46d-58e7ea849d3f req-b7d7e066-b7fc-4ded-b1d5-5ff14dcdf9a5 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:29.435298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-a5984caf-5bbc-4a73-b46d-58e7ea849d3f req-b7d7e066-b7fc-4ded-b1d5-5ff14dcdf9a5 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:29.487848 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-6aa5dcde-7e37-4450-b4cf-0de94e965b8d req-5c63a19d-c68f-48b6-8c8f-3fcdf2783326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ceac9b-808a-455a-9409-817a9675cc84", "tag": "7cff6837-1499-4d0c-af41-27acd223363c"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:29.521724 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-6aa5dcde-7e37-4450-b4cf-0de94e965b8d req-5c63a19d-c68f-48b6-8c8f-3fcdf2783326 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:29.522404 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-a5984caf-5bbc-4a73-b46d-58e7ea849d3f req-b7d7e066-b7fc-4ded-b1d5-5ff14dcdf9a5 service nova] Creating event network-changed:bd404336-185f-4a39-8576-5211044a2340 for instance 2d3f3442-a00e-47ee-b0df-f099086628ce on hv-cinder-84684 Jun 30 04:15:29.523284 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-a5984caf-5bbc-4a73-b46d-58e7ea849d3f req-b7d7e066-b7fc-4ded-b1d5-5ff14dcdf9a5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118187) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 04:15:29.525267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-6aa5dcde-7e37-4450-b4cf-0de94e965b8d req-5c63a19d-c68f-48b6-8c8f-3fcdf2783326 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:29.527810 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c06806c7-5ac8-48b8-8533-ca1714de8db8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:29.528489 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c06806c7-5ac8-48b8-8533-ca1714de8db8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:29.531335 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c06806c7-5ac8-48b8-8533-ca1714de8db8 None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:29.531998 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c06806c7-5ac8-48b8-8533-ca1714de8db8 None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:29.558903 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.compute.rpcapi [None req-c06806c7-5ac8-48b8-8533-ca1714de8db8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 04:15:29.561833 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c06806c7-5ac8-48b8-8533-ca1714de8db8 None None] Releasing lock "compute-rpcapi-router" {{(pid=118187) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 04:15:29.580234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-6aa5dcde-7e37-4450-b4cf-0de94e965b8d req-5c63a19d-c68f-48b6-8c8f-3fcdf2783326 service nova] Creating event network-changed:7cff6837-1499-4d0c-af41-27acd223363c for instance 43ceac9b-808a-455a-9409-817a9675cc84 on hv-cinder-84684 Jun 30 04:15:29.581723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-6aa5dcde-7e37-4450-b4cf-0de94e965b8d req-5c63a19d-c68f-48b6-8c8f-3fcdf2783326 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118188) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 04:15:29.583504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fc1c0f31-28e8-4863-a5f1-510fbf80114b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:29.584097 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fc1c0f31-28e8-4863-a5f1-510fbf80114b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:29.585277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fc1c0f31-28e8-4863-a5f1-510fbf80114b None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:29.585908 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fc1c0f31-28e8-4863-a5f1-510fbf80114b None None] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:29.597149 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c06806c7-5ac8-48b8-8533-ca1714de8db8 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.683209 Jun 30 04:15:29.598012 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 24/58] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:29.604656 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-51901bc8-4ec6-4267-b75f-59bdd02f1e44 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Calling method '.version_select at 0x7fb480f4bd30>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:29.618049 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.compute.rpcapi [None req-fc1c0f31-28e8-4863-a5f1-510fbf80114b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 04:15:29.619414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fc1c0f31-28e8-4863-a5f1-510fbf80114b None None] Releasing lock "compute-rpcapi-router" {{(pid=118188) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 04:15:29.662544 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fc1c0f31-28e8-4863-a5f1-510fbf80114b None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.744096 Jun 30 04:15:29.663566 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 35/59] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:29.667603 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-51901bc8-4ec6-4267-b75f-59bdd02f1e44 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] HTTP exception thrown: Volume 5ee3e5d4-a7a6-465e-bfa5-00753fbafe17 could not be found. Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-51901bc8-4ec6-4267-b75f-59bdd02f1e44 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Request method failure captured: Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/os-volumes/5ee3e5d4-a7a6-465e-bfa5-00753fbafe17 HTTP/1.1 Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSNed-zGoWXvYCaffpqlTgsZgYQ_lV0E0cjfe_AVvUfIawZNzT_vs0cejzxd2AQwpPplvy9DjFkaevIFECZ9tNuH7EiD4uHIriEnMOtQXvfLSv8fw9IDqjZdHN0JOjGTpxYnZR1RnfvCInETJJSSAxrfna5xwxG4pvOAg54c0sLAYT4 Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:15:29.670083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f3525c22b215472ca04b6cd2a7e76f84"}]}] Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: bc92263566814e9b98d611d0c03f5e81 Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Volume 5ee3e5d4-a7a6-465e-bfa5-00753fbafe17 could not be found. Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '5ee3e5d4-a7a6-465e-bfa5-00753fbafe17'} Jun 30 04:15:29.671439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ee3e5d4-a7a6-465e-bfa5-00753fbafe17 could not be found. (HTTP 404) (Request-ID: req-30c61e97-e6e4-49c2-9c99-d21f8ef17ff3) Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:29.672141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 04:15:29.673156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ee3e5d4-a7a6-465e-bfa5-00753fbafe17 could not be found. Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 04:15:29.674252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ee3e5d4-a7a6-465e-bfa5-00753fbafe17 could not be found. Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ee3e5d4-a7a6-465e-bfa5-00753fbafe17 could not be found. Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-51901bc8-4ec6-4267-b75f-59bdd02f1e44 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Returning 404 to user: Volume 5ee3e5d4-a7a6-465e-bfa5-00753fbafe17 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-51901bc8-4ec6-4267-b75f-59bdd02f1e44 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/5ee3e5d4-a7a6-465e-bfa5-00753fbafe17" status: 404 len: 109 microversion: 2.1 time: 0.072052 Jun 30 04:15:29.676128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 25/60] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 30 04:15:29 2022] DELETE /compute/v2.1/os-volumes/5ee3e5d4-a7a6-465e-bfa5-00753fbafe17 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:15:29.689131 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1b0e77df-166c-48be-ac92-06a53d961f28 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Calling method '.version_select at 0x7fb480f8faf0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:29.731040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=12 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:29.784013 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-1b0e77df-166c-48be-ac92-06a53d961f28 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] HTTP exception thrown: Volume 460c61a1-5acc-4e60-9e1f-ef9abbc22ad7 could not be found. Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1b0e77df-166c-48be-ac92-06a53d961f28 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Request method failure captured: Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/os-volumes/460c61a1-5acc-4e60-9e1f-ef9abbc22ad7 HTTP/1.1 Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSNed-zGoWXvYCaffpqlTgsZgYQ_lV0E0cjfe_AVvUfIawZNzT_vs0cejzxd2AQwpPplvy9DjFkaevIFECZ9tNuH7EiD4uHIriEnMOtQXvfLSv8fw9IDqjZdHN0JOjGTpxYnZR1RnfvCInETJJSSAxrfna5xwxG4pvOAg54c0sLAYT4 Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:15:29.786504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3525c22b215472ca04b6cd2a7e76f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f3525c22b215472ca04b6cd2a7e76f84"}]}] Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: f3525c22b215472ca04b6cd2a7e76f84 Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-VolumesNegativeTest-1367965758 Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: bc92263566814e9b98d611d0c03f5e81 Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-VolumesNegativeTest-1367965758-project Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Volume 460c61a1-5acc-4e60-9e1f-ef9abbc22ad7 could not be found. Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '460c61a1-5acc-4e60-9e1f-ef9abbc22ad7'} Jun 30 04:15:29.787680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 460c61a1-5acc-4e60-9e1f-ef9abbc22ad7 could not be found. (HTTP 404) (Request-ID: req-026bd8de-94a1-4556-9367-757e4a472871) Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:29.788495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 04:15:29.789979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 460c61a1-5acc-4e60-9e1f-ef9abbc22ad7 could not be found. Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 04:15:29.792805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 460c61a1-5acc-4e60-9e1f-ef9abbc22ad7 could not be found. Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 460c61a1-5acc-4e60-9e1f-ef9abbc22ad7 could not be found. Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1b0e77df-166c-48be-ac92-06a53d961f28 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] Returning 404 to user: Volume 460c61a1-5acc-4e60-9e1f-ef9abbc22ad7 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1b0e77df-166c-48be-ac92-06a53d961f28 tempest-VolumesNegativeTest-1367965758 tempest-VolumesNegativeTest-1367965758-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/460c61a1-5acc-4e60-9e1f-ef9abbc22ad7" status: 404 len: 109 microversion: 2.1 time: 0.109197 Jun 30 04:15:29.794569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 36/61] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:15:29 2022] GET /compute/v2.1/os-volumes/460c61a1-5acc-4e60-9e1f-ef9abbc22ad7 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:15:29.920024 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-935e287d-6f7d-40fd-b915-fb005819ba75 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:29.921746 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-935e287d-6f7d-40fd-b915-fb005819ba75 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:29.934013 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-51bc9096-8cdc-4b45-9daa-36f8d144ba20 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:29.935975 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-51bc9096-8cdc-4b45-9daa-36f8d144ba20 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:29.946119 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51bc9096-8cdc-4b45-9daa-36f8d144ba20 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:29.946740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51bc9096-8cdc-4b45-9daa-36f8d144ba20 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:29.947734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51bc9096-8cdc-4b45-9daa-36f8d144ba20 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:29.948300 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51bc9096-8cdc-4b45-9daa-36f8d144ba20 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:29.955234 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-935e287d-6f7d-40fd-b915-fb005819ba75 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:29.956001 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-935e287d-6f7d-40fd-b915-fb005819ba75 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:29.957174 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-935e287d-6f7d-40fd-b915-fb005819ba75 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:29.957763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-935e287d-6f7d-40fd-b915-fb005819ba75 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:30.833529 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-51bc9096-8cdc-4b45-9daa-36f8d144ba20 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:30.839803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-935e287d-6f7d-40fd-b915-fb005819ba75 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:30.849021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-935e287d-6f7d-40fd-b915-fb005819ba75 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.933031 Jun 30 04:15:30.849598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 26/62] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:29 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:30.853074 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-51bc9096-8cdc-4b45-9daa-36f8d144ba20 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:30.858325 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-51bc9096-8cdc-4b45-9daa-36f8d144ba20 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:30.871744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-51bc9096-8cdc-4b45-9daa-36f8d144ba20 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.940788 Jun 30 04:15:30.875652 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 37/63] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:29 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:31.870650 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b031ac41-b34a-44da-b9f1-ff5a807c6e7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:31.871646 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b031ac41-b34a-44da-b9f1-ff5a807c6e7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:31.880962 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b031ac41-b34a-44da-b9f1-ff5a807c6e7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:31.882041 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b031ac41-b34a-44da-b9f1-ff5a807c6e7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:31.883831 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b031ac41-b34a-44da-b9f1-ff5a807c6e7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:31.884472 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b031ac41-b34a-44da-b9f1-ff5a807c6e7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:31.893124 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-627b4ef6-9f92-4456-9f7e-55020610ee81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:31.893755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-627b4ef6-9f92-4456-9f7e-55020610ee81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:31.901897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-627b4ef6-9f92-4456-9f7e-55020610ee81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:31.908291 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-627b4ef6-9f92-4456-9f7e-55020610ee81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:31.910086 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-627b4ef6-9f92-4456-9f7e-55020610ee81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:31.912881 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-627b4ef6-9f92-4456-9f7e-55020610ee81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:32.429252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b031ac41-b34a-44da-b9f1-ff5a807c6e7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:32.441195 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b031ac41-b34a-44da-b9f1-ff5a807c6e7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.578967 Jun 30 04:15:32.447424 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 27/64] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:31 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:32.561067 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-627b4ef6-9f92-4456-9f7e-55020610ee81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:32.573546 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-627b4ef6-9f92-4456-9f7e-55020610ee81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:32.575127 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-627b4ef6-9f92-4456-9f7e-55020610ee81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:32.579508 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-627b4ef6-9f92-4456-9f7e-55020610ee81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.687145 Jun 30 04:15:32.580456 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 38/65] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:31 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:15:33.461545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2c75fbe4-3c46-48e5-984a-a154efb03484 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:33.462885 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2c75fbe4-3c46-48e5-984a-a154efb03484 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:33.469833 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c75fbe4-3c46-48e5-984a-a154efb03484 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:33.470278 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c75fbe4-3c46-48e5-984a-a154efb03484 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:33.471238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c75fbe4-3c46-48e5-984a-a154efb03484 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:33.471678 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c75fbe4-3c46-48e5-984a-a154efb03484 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:33.598457 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-657a1abf-033e-4cda-bf71-69aae16d3485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:33.599072 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-657a1abf-033e-4cda-bf71-69aae16d3485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:33.606551 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-657a1abf-033e-4cda-bf71-69aae16d3485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:33.606993 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-657a1abf-033e-4cda-bf71-69aae16d3485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:33.607860 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-657a1abf-033e-4cda-bf71-69aae16d3485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:33.608295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-657a1abf-033e-4cda-bf71-69aae16d3485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:33.664023 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2c75fbe4-3c46-48e5-984a-a154efb03484 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:33.676271 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2c75fbe4-3c46-48e5-984a-a154efb03484 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.217213 Jun 30 04:15:33.678878 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 28/66] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:33 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:33.792651 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-657a1abf-033e-4cda-bf71-69aae16d3485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:33.813084 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-657a1abf-033e-4cda-bf71-69aae16d3485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:33.814612 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-657a1abf-033e-4cda-bf71-69aae16d3485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:33.815797 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-657a1abf-033e-4cda-bf71-69aae16d3485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.221480 Jun 30 04:15:33.816515 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 39/67] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:33 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:34.694690 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2c8dbac3-a450-4d95-af0b-b5d10866b77e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:34.695327 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2c8dbac3-a450-4d95-af0b-b5d10866b77e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:34.697408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:34.704865 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c8dbac3-a450-4d95-af0b-b5d10866b77e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:34.706908 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c8dbac3-a450-4d95-af0b-b5d10866b77e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:34.714014 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c8dbac3-a450-4d95-af0b-b5d10866b77e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:34.714524 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c8dbac3-a450-4d95-af0b-b5d10866b77e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:34.834786 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-74f0022a-9198-4664-b2bb-a733b3533aa8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:34.836034 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-74f0022a-9198-4664-b2bb-a733b3533aa8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:34.850351 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-74f0022a-9198-4664-b2bb-a733b3533aa8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:34.851030 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-74f0022a-9198-4664-b2bb-a733b3533aa8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:34.852314 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-74f0022a-9198-4664-b2bb-a733b3533aa8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:34.853059 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-74f0022a-9198-4664-b2bb-a733b3533aa8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:34.888327 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2c8dbac3-a450-4d95-af0b-b5d10866b77e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:34.897495 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2c8dbac3-a450-4d95-af0b-b5d10866b77e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.206627 Jun 30 04:15:34.898624 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 29/68] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:34 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:35.085708 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-74f0022a-9198-4664-b2bb-a733b3533aa8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:35.098292 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-74f0022a-9198-4664-b2bb-a733b3533aa8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:35.100636 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-74f0022a-9198-4664-b2bb-a733b3533aa8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:35.109519 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-74f0022a-9198-4664-b2bb-a733b3533aa8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.272473 Jun 30 04:15:35.125335 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 40/69] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:34 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:15:35.915217 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f3a6ced5-a171-416e-b6f4-2ae53d08e658 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:35.916391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f3a6ced5-a171-416e-b6f4-2ae53d08e658 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:35.923779 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3a6ced5-a171-416e-b6f4-2ae53d08e658 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:35.924651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3a6ced5-a171-416e-b6f4-2ae53d08e658 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:35.925938 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3a6ced5-a171-416e-b6f4-2ae53d08e658 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:35.926550 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3a6ced5-a171-416e-b6f4-2ae53d08e658 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:36.100882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f3a6ced5-a171-416e-b6f4-2ae53d08e658 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:36.112926 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f3a6ced5-a171-416e-b6f4-2ae53d08e658 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.201285 Jun 30 04:15:36.113390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 30/70] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:35 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:36.128599 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8a4c007a-7f56-4f30-a810-171fcc3ca265 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:36.129331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8a4c007a-7f56-4f30-a810-171fcc3ca265 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:36.135864 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8a4c007a-7f56-4f30-a810-171fcc3ca265 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:36.136610 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8a4c007a-7f56-4f30-a810-171fcc3ca265 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:36.137386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8a4c007a-7f56-4f30-a810-171fcc3ca265 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:36.138085 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8a4c007a-7f56-4f30-a810-171fcc3ca265 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:36.304221 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8a4c007a-7f56-4f30-a810-171fcc3ca265 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:36.312963 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8a4c007a-7f56-4f30-a810-171fcc3ca265 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:36.314455 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8a4c007a-7f56-4f30-a810-171fcc3ca265 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:36.315924 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8a4c007a-7f56-4f30-a810-171fcc3ca265 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.191392 Jun 30 04:15:36.316659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 41/71] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:36 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:37.130276 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4943ef49-00d8-401f-9eeb-3b569184ed21 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:37.131923 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4943ef49-00d8-401f-9eeb-3b569184ed21 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:37.138114 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4943ef49-00d8-401f-9eeb-3b569184ed21 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:37.138853 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4943ef49-00d8-401f-9eeb-3b569184ed21 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:37.139888 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4943ef49-00d8-401f-9eeb-3b569184ed21 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:37.140352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4943ef49-00d8-401f-9eeb-3b569184ed21 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:37.286513 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4943ef49-00d8-401f-9eeb-3b569184ed21 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:37.295765 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4943ef49-00d8-401f-9eeb-3b569184ed21 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.168893 Jun 30 04:15:37.296405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 31/72] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:37 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:37.334276 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cde5b4ab-e563-4495-91ae-442f013bea2c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:37.334862 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cde5b4ab-e563-4495-91ae-442f013bea2c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:37.343871 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cde5b4ab-e563-4495-91ae-442f013bea2c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:37.344455 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cde5b4ab-e563-4495-91ae-442f013bea2c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:37.345566 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cde5b4ab-e563-4495-91ae-442f013bea2c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:37.346141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cde5b4ab-e563-4495-91ae-442f013bea2c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:37.571158 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cde5b4ab-e563-4495-91ae-442f013bea2c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:37.580738 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cde5b4ab-e563-4495-91ae-442f013bea2c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:37.582337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cde5b4ab-e563-4495-91ae-442f013bea2c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:37.583495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cde5b4ab-e563-4495-91ae-442f013bea2c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.253365 Jun 30 04:15:37.584224 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 42/73] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:37 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:38.314721 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d688d53f-eabd-4e25-ba6e-7f527f391549 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:38.316596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d688d53f-eabd-4e25-ba6e-7f527f391549 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:38.325652 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d688d53f-eabd-4e25-ba6e-7f527f391549 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:38.327146 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d688d53f-eabd-4e25-ba6e-7f527f391549 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:38.328073 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d688d53f-eabd-4e25-ba6e-7f527f391549 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:38.328637 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d688d53f-eabd-4e25-ba6e-7f527f391549 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:38.510044 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d688d53f-eabd-4e25-ba6e-7f527f391549 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:38.521693 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d688d53f-eabd-4e25-ba6e-7f527f391549 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.212592 Jun 30 04:15:38.525580 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 32/74] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:38 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:38.605094 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3bedfc29-95c9-4f6a-ac87-b8e4b62f2b5c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:38.605920 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3bedfc29-95c9-4f6a-ac87-b8e4b62f2b5c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:38.614476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3bedfc29-95c9-4f6a-ac87-b8e4b62f2b5c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:38.614476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3bedfc29-95c9-4f6a-ac87-b8e4b62f2b5c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:38.614838 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3bedfc29-95c9-4f6a-ac87-b8e4b62f2b5c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:38.615682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3bedfc29-95c9-4f6a-ac87-b8e4b62f2b5c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:38.759071 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3bedfc29-95c9-4f6a-ac87-b8e4b62f2b5c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:38.769870 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3bedfc29-95c9-4f6a-ac87-b8e4b62f2b5c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:38.771829 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3bedfc29-95c9-4f6a-ac87-b8e4b62f2b5c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:38.772947 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3bedfc29-95c9-4f6a-ac87-b8e4b62f2b5c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.173867 Jun 30 04:15:38.773598 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 43/75] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:38 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:39.539351 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6970df27-5ad1-4360-9a01-87d999f6a950 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:39.539961 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6970df27-5ad1-4360-9a01-87d999f6a950 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:39.546463 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6970df27-5ad1-4360-9a01-87d999f6a950 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:39.546900 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6970df27-5ad1-4360-9a01-87d999f6a950 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:39.547646 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6970df27-5ad1-4360-9a01-87d999f6a950 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:39.548249 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6970df27-5ad1-4360-9a01-87d999f6a950 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:39.557068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:39.718237 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6970df27-5ad1-4360-9a01-87d999f6a950 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:39.725932 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6970df27-5ad1-4360-9a01-87d999f6a950 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.190785 Jun 30 04:15:39.735419 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 33/76] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:39 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:39.788256 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:39.792528 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ce15cdfb-3827-433c-b32f-cc13c143d1dc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:39.793419 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ce15cdfb-3827-433c-b32f-cc13c143d1dc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:39.800205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ce15cdfb-3827-433c-b32f-cc13c143d1dc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:39.800647 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ce15cdfb-3827-433c-b32f-cc13c143d1dc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:39.801404 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ce15cdfb-3827-433c-b32f-cc13c143d1dc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:39.801828 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ce15cdfb-3827-433c-b32f-cc13c143d1dc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:39.955993 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ce15cdfb-3827-433c-b32f-cc13c143d1dc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:39.964480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ce15cdfb-3827-433c-b32f-cc13c143d1dc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:39.966005 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ce15cdfb-3827-433c-b32f-cc13c143d1dc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:39.967974 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ce15cdfb-3827-433c-b32f-cc13c143d1dc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.180068 Jun 30 04:15:39.968872 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 44/77] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:39 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:40.745916 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6fa3f3b3-6767-4957-bda2-7789601774a3 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:40.747460 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6fa3f3b3-6767-4957-bda2-7789601774a3 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:40.754028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6fa3f3b3-6767-4957-bda2-7789601774a3 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:40.754473 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6fa3f3b3-6767-4957-bda2-7789601774a3 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:40.755341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6fa3f3b3-6767-4957-bda2-7789601774a3 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:40.755779 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6fa3f3b3-6767-4957-bda2-7789601774a3 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:40.760228 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:40.899463 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6fa3f3b3-6767-4957-bda2-7789601774a3 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:40.909973 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6fa3f3b3-6767-4957-bda2-7789601774a3 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.169978 Jun 30 04:15:40.911180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 34/78] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:40 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:40.987764 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-aa1f1cd6-4c61-45af-96f8-92e7d4176db3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:40.988389 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-aa1f1cd6-4c61-45af-96f8-92e7d4176db3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:40.992171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:40.996364 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aa1f1cd6-4c61-45af-96f8-92e7d4176db3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:40.996925 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aa1f1cd6-4c61-45af-96f8-92e7d4176db3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:40.997991 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aa1f1cd6-4c61-45af-96f8-92e7d4176db3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:40.998497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aa1f1cd6-4c61-45af-96f8-92e7d4176db3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:41.150538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-aa1f1cd6-4c61-45af-96f8-92e7d4176db3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:41.158672 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-aa1f1cd6-4c61-45af-96f8-92e7d4176db3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:41.160202 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-aa1f1cd6-4c61-45af-96f8-92e7d4176db3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:41.161669 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-aa1f1cd6-4c61-45af-96f8-92e7d4176db3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.179671 Jun 30 04:15:41.162518 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 45/79] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:40 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:41.928327 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-197995af-f96a-41b7-9b74-c817664b45c6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:41.929071 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-197995af-f96a-41b7-9b74-c817664b45c6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:41.935336 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-197995af-f96a-41b7-9b74-c817664b45c6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:41.936036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-197995af-f96a-41b7-9b74-c817664b45c6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:41.936721 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-197995af-f96a-41b7-9b74-c817664b45c6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:41.937148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-197995af-f96a-41b7-9b74-c817664b45c6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:42.087343 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-197995af-f96a-41b7-9b74-c817664b45c6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:42.098826 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-197995af-f96a-41b7-9b74-c817664b45c6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.174296 Jun 30 04:15:42.099627 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 35/80] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:41 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:42.179429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-562d4c55-4976-41f0-8349-7f5529571cb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:42.180055 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-562d4c55-4976-41f0-8349-7f5529571cb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:42.187122 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-562d4c55-4976-41f0-8349-7f5529571cb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:42.188642 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-562d4c55-4976-41f0-8349-7f5529571cb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:42.189442 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-562d4c55-4976-41f0-8349-7f5529571cb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:42.189825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-562d4c55-4976-41f0-8349-7f5529571cb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:42.368778 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-562d4c55-4976-41f0-8349-7f5529571cb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:42.377917 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-562d4c55-4976-41f0-8349-7f5529571cb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:42.379450 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-562d4c55-4976-41f0-8349-7f5529571cb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:42.380724 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-562d4c55-4976-41f0-8349-7f5529571cb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.205221 Jun 30 04:15:42.381762 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 46/81] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:42 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:43.116733 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3d5efcca-d270-45de-9dbf-ddb1963f56e6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:43.118027 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3d5efcca-d270-45de-9dbf-ddb1963f56e6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:43.124224 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3d5efcca-d270-45de-9dbf-ddb1963f56e6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:43.124875 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3d5efcca-d270-45de-9dbf-ddb1963f56e6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:43.125637 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3d5efcca-d270-45de-9dbf-ddb1963f56e6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:43.126218 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3d5efcca-d270-45de-9dbf-ddb1963f56e6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:43.321103 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3d5efcca-d270-45de-9dbf-ddb1963f56e6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:43.330553 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3d5efcca-d270-45de-9dbf-ddb1963f56e6 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.217904 Jun 30 04:15:43.340158 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 36/82] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:43 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:43.399778 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-36d1f937-4d8f-46c5-bd08-8bc46118ea6f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:43.400385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-36d1f937-4d8f-46c5-bd08-8bc46118ea6f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:43.407058 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36d1f937-4d8f-46c5-bd08-8bc46118ea6f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:43.407578 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36d1f937-4d8f-46c5-bd08-8bc46118ea6f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:43.408331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36d1f937-4d8f-46c5-bd08-8bc46118ea6f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:43.408754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36d1f937-4d8f-46c5-bd08-8bc46118ea6f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:43.551468 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-36d1f937-4d8f-46c5-bd08-8bc46118ea6f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:43.555306 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=100 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:15:43.561364 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-36d1f937-4d8f-46c5-bd08-8bc46118ea6f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:43.562910 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-36d1f937-4d8f-46c5-bd08-8bc46118ea6f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:43.564085 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-36d1f937-4d8f-46c5-bd08-8bc46118ea6f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.168201 Jun 30 04:15:43.564627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 47/83] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:43 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:44.347530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-217e809c-7c42-45fd-b13e-37a62f3b4d06 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:44.348133 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-217e809c-7c42-45fd-b13e-37a62f3b4d06 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:44.355006 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-217e809c-7c42-45fd-b13e-37a62f3b4d06 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:44.355516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-217e809c-7c42-45fd-b13e-37a62f3b4d06 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:44.356254 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-217e809c-7c42-45fd-b13e-37a62f3b4d06 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:44.356716 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-217e809c-7c42-45fd-b13e-37a62f3b4d06 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:44.493735 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-217e809c-7c42-45fd-b13e-37a62f3b4d06 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:44.501349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-217e809c-7c42-45fd-b13e-37a62f3b4d06 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.157679 Jun 30 04:15:44.501919 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 37/84] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:44 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:44.587821 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1da64e2e-8c5a-4884-ac13-f4d990199fb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:44.588422 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1da64e2e-8c5a-4884-ac13-f4d990199fb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:44.596208 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1da64e2e-8c5a-4884-ac13-f4d990199fb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:44.596683 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1da64e2e-8c5a-4884-ac13-f4d990199fb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:44.597463 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1da64e2e-8c5a-4884-ac13-f4d990199fb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:44.597895 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1da64e2e-8c5a-4884-ac13-f4d990199fb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:44.732411 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1da64e2e-8c5a-4884-ac13-f4d990199fb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:44.740426 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1da64e2e-8c5a-4884-ac13-f4d990199fb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:44.741920 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1da64e2e-8c5a-4884-ac13-f4d990199fb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:44.743226 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1da64e2e-8c5a-4884-ac13-f4d990199fb7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.164830 Jun 30 04:15:44.743810 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 48/85] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:44 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:45.518324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a33e241e-2ca3-4a5c-8e8e-5ba4c82f9500 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:45.519083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a33e241e-2ca3-4a5c-8e8e-5ba4c82f9500 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:45.525717 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a33e241e-2ca3-4a5c-8e8e-5ba4c82f9500 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:45.526169 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a33e241e-2ca3-4a5c-8e8e-5ba4c82f9500 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:45.526940 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a33e241e-2ca3-4a5c-8e8e-5ba4c82f9500 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:45.527416 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a33e241e-2ca3-4a5c-8e8e-5ba4c82f9500 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:45.663994 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a33e241e-2ca3-4a5c-8e8e-5ba4c82f9500 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:45.672089 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a33e241e-2ca3-4a5c-8e8e-5ba4c82f9500 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.157985 Jun 30 04:15:45.672632 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 38/86] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:45 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:45.761510 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7d2e1be0-bc07-4350-b77e-8d5a8a14be06 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:45.762112 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7d2e1be0-bc07-4350-b77e-8d5a8a14be06 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:45.769488 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d2e1be0-bc07-4350-b77e-8d5a8a14be06 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:45.769922 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d2e1be0-bc07-4350-b77e-8d5a8a14be06 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:45.770666 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d2e1be0-bc07-4350-b77e-8d5a8a14be06 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:45.771085 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d2e1be0-bc07-4350-b77e-8d5a8a14be06 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:45.906134 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7d2e1be0-bc07-4350-b77e-8d5a8a14be06 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:45.914803 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7d2e1be0-bc07-4350-b77e-8d5a8a14be06 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:45.916339 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7d2e1be0-bc07-4350-b77e-8d5a8a14be06 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:45.917460 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7d2e1be0-bc07-4350-b77e-8d5a8a14be06 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.159913 Jun 30 04:15:45.918019 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 49/87] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:45 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:46.688965 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2cf26ca8-dd3d-49d7-bf8a-0afc44a1a9af tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:46.689422 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2cf26ca8-dd3d-49d7-bf8a-0afc44a1a9af tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:46.695916 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2cf26ca8-dd3d-49d7-bf8a-0afc44a1a9af tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:46.696384 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2cf26ca8-dd3d-49d7-bf8a-0afc44a1a9af tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:46.697159 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2cf26ca8-dd3d-49d7-bf8a-0afc44a1a9af tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:46.697595 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2cf26ca8-dd3d-49d7-bf8a-0afc44a1a9af tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:46.831401 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2cf26ca8-dd3d-49d7-bf8a-0afc44a1a9af tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:46.839708 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2cf26ca8-dd3d-49d7-bf8a-0afc44a1a9af tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.154801 Jun 30 04:15:46.840550 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 39/88] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:46 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:46.935301 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1707e53a-c455-4fe5-a9e0-d6bb64574399 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:46.936474 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1707e53a-c455-4fe5-a9e0-d6bb64574399 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:46.942883 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1707e53a-c455-4fe5-a9e0-d6bb64574399 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:46.943358 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1707e53a-c455-4fe5-a9e0-d6bb64574399 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:46.944110 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1707e53a-c455-4fe5-a9e0-d6bb64574399 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:46.944537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1707e53a-c455-4fe5-a9e0-d6bb64574399 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:47.113160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1707e53a-c455-4fe5-a9e0-d6bb64574399 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:47.125353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1707e53a-c455-4fe5-a9e0-d6bb64574399 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:47.126872 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1707e53a-c455-4fe5-a9e0-d6bb64574399 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:47.128026 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1707e53a-c455-4fe5-a9e0-d6bb64574399 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.196741 Jun 30 04:15:47.128965 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 50/89] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:46 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:47.577923 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-2ee5d226-7403-49c4-8a99-5f71e36dd0aa req-c89fd0ac-53dd-4ce0-960d-eaf16c7b8cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3f3442-a00e-47ee-b0df-f099086628ce", "name": "network-vif-plugged", "status": "completed", "tag": "bd404336-185f-4a39-8576-5211044a2340"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:47.603542 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-2ee5d226-7403-49c4-8a99-5f71e36dd0aa req-c89fd0ac-53dd-4ce0-960d-eaf16c7b8cae service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:47.604211 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-2ee5d226-7403-49c4-8a99-5f71e36dd0aa req-c89fd0ac-53dd-4ce0-960d-eaf16c7b8cae service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:47.618779 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-2ee5d226-7403-49c4-8a99-5f71e36dd0aa req-c89fd0ac-53dd-4ce0-960d-eaf16c7b8cae service nova] Creating event network-vif-plugged:bd404336-185f-4a39-8576-5211044a2340 for instance 2d3f3442-a00e-47ee-b0df-f099086628ce on hv-cinder-84684 Jun 30 04:15:47.625372 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-2ee5d226-7403-49c4-8a99-5f71e36dd0aa req-c89fd0ac-53dd-4ce0-960d-eaf16c7b8cae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226300 Jun 30 04:15:47.626582 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 40/90] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:47.859616 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6d401ebd-1ab8-4832-a585-75226c2f2dcb tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:47.860589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6d401ebd-1ab8-4832-a585-75226c2f2dcb tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:47.868677 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6d401ebd-1ab8-4832-a585-75226c2f2dcb tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:47.869518 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6d401ebd-1ab8-4832-a585-75226c2f2dcb tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:47.870268 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6d401ebd-1ab8-4832-a585-75226c2f2dcb tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:47.870695 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6d401ebd-1ab8-4832-a585-75226c2f2dcb tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:48.085173 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6d401ebd-1ab8-4832-a585-75226c2f2dcb tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:48.094111 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6d401ebd-1ab8-4832-a585-75226c2f2dcb tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.240135 Jun 30 04:15:48.094865 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 51/91] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:47 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:48.146635 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-da93a936-cb26-4104-aae2-709129185685 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:48.148200 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-da93a936-cb26-4104-aae2-709129185685 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:48.157384 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da93a936-cb26-4104-aae2-709129185685 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:48.158064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da93a936-cb26-4104-aae2-709129185685 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:48.159765 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da93a936-cb26-4104-aae2-709129185685 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:48.160830 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da93a936-cb26-4104-aae2-709129185685 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:48.337936 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-da93a936-cb26-4104-aae2-709129185685 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:48.348292 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-da93a936-cb26-4104-aae2-709129185685 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:48.355236 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-da93a936-cb26-4104-aae2-709129185685 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:48.356354 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-da93a936-cb26-4104-aae2-709129185685 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.214352 Jun 30 04:15:48.357550 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 41/92] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:48 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:49.111796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-01d3169f-ce07-49c1-97aa-5f2d5d335a7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:49.112409 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-01d3169f-ce07-49c1-97aa-5f2d5d335a7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:49.119328 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-01d3169f-ce07-49c1-97aa-5f2d5d335a7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:49.120034 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-01d3169f-ce07-49c1-97aa-5f2d5d335a7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:49.120871 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-01d3169f-ce07-49c1-97aa-5f2d5d335a7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:49.121393 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-01d3169f-ce07-49c1-97aa-5f2d5d335a7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:49.260550 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-01d3169f-ce07-49c1-97aa-5f2d5d335a7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:49.268436 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-01d3169f-ce07-49c1-97aa-5f2d5d335a7a tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.160635 Jun 30 04:15:49.269091 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 52/93] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:49 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:15:49.375962 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-16bf8845-b1db-437d-800d-61f4a315cf96 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:49.377189 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-16bf8845-b1db-437d-800d-61f4a315cf96 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:49.383932 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-16bf8845-b1db-437d-800d-61f4a315cf96 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:49.384419 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-16bf8845-b1db-437d-800d-61f4a315cf96 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:49.385171 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-16bf8845-b1db-437d-800d-61f4a315cf96 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:49.385599 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-16bf8845-b1db-437d-800d-61f4a315cf96 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:49.550271 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-16bf8845-b1db-437d-800d-61f4a315cf96 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:49.558932 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-16bf8845-b1db-437d-800d-61f4a315cf96 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:49.564858 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-16bf8845-b1db-437d-800d-61f4a315cf96 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:49.566469 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-16bf8845-b1db-437d-800d-61f4a315cf96 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1408 microversion: 2.20 time: 0.195231 Jun 30 04:15:49.569041 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 42/94] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:49 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:49.642339 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-e2c570f6-9d97-4906-a54e-6eeaa67fdd64 req-12f16772-19f2-46ee-8ab7-8f8ef4ca0837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ceac9b-808a-455a-9409-817a9675cc84", "name": "network-vif-plugged", "status": "completed", "tag": "7cff6837-1499-4d0c-af41-27acd223363c"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:49.661390 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-e2c570f6-9d97-4906-a54e-6eeaa67fdd64 req-12f16772-19f2-46ee-8ab7-8f8ef4ca0837 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:49.662278 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-e2c570f6-9d97-4906-a54e-6eeaa67fdd64 req-12f16772-19f2-46ee-8ab7-8f8ef4ca0837 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:49.681102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-e2c570f6-9d97-4906-a54e-6eeaa67fdd64 req-12f16772-19f2-46ee-8ab7-8f8ef4ca0837 service nova] Creating event network-vif-plugged:7cff6837-1499-4d0c-af41-27acd223363c for instance 43ceac9b-808a-455a-9409-817a9675cc84 on hv-cinder-84684 Jun 30 04:15:49.692491 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-e2c570f6-9d97-4906-a54e-6eeaa67fdd64 req-12f16772-19f2-46ee-8ab7-8f8ef4ca0837 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053377 Jun 30 04:15:49.697686 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 53/95] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:50.286861 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-90dbb8c7-97b5-4afe-80c8-668d3636ea2e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:50.287501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-90dbb8c7-97b5-4afe-80c8-668d3636ea2e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:50.302704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-90dbb8c7-97b5-4afe-80c8-668d3636ea2e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:50.303186 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-90dbb8c7-97b5-4afe-80c8-668d3636ea2e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:50.303988 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-90dbb8c7-97b5-4afe-80c8-668d3636ea2e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:50.304417 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-90dbb8c7-97b5-4afe-80c8-668d3636ea2e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:50.559311 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-90dbb8c7-97b5-4afe-80c8-668d3636ea2e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:50.580089 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-90dbb8c7-97b5-4afe-80c8-668d3636ea2e tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.297729 Jun 30 04:15:50.581005 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 43/96] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:50 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:50.592376 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4170d772-1add-496b-a10e-6438a4aac236 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:50.593069 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4170d772-1add-496b-a10e-6438a4aac236 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:50.604332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4170d772-1add-496b-a10e-6438a4aac236 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:50.605000 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4170d772-1add-496b-a10e-6438a4aac236 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:50.606340 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4170d772-1add-496b-a10e-6438a4aac236 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:50.607184 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4170d772-1add-496b-a10e-6438a4aac236 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:50.823565 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4170d772-1add-496b-a10e-6438a4aac236 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:50.833507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4170d772-1add-496b-a10e-6438a4aac236 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:50.835018 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4170d772-1add-496b-a10e-6438a4aac236 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:50.837295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4170d772-1add-496b-a10e-6438a4aac236 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1600 microversion: 2.20 time: 0.252296 Jun 30 04:15:50.837871 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 54/97] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:15:50 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1600 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:15:50.855991 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-212acbeb-2dec-4102-92f4-1c4456d169e2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:50.856866 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-212acbeb-2dec-4102-92f4-1c4456d169e2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:50.863929 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-212acbeb-2dec-4102-92f4-1c4456d169e2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:50.864632 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-212acbeb-2dec-4102-92f4-1c4456d169e2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:50.865620 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-212acbeb-2dec-4102-92f4-1c4456d169e2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:50.866241 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-212acbeb-2dec-4102-92f4-1c4456d169e2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:51.077349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-212acbeb-2dec-4102-92f4-1c4456d169e2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.225520 Jun 30 04:15:51.078401 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 44/98] 10.222.0.13 () {60 vars in 1315 bytes} [Thu Jun 30 04:15:50 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:15:51.601591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a9063eb4-cd4f-4a54-8e41-913f60d6cfc2 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:51.602312 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a9063eb4-cd4f-4a54-8e41-913f60d6cfc2 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:51.610986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9063eb4-cd4f-4a54-8e41-913f60d6cfc2 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:51.611553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9063eb4-cd4f-4a54-8e41-913f60d6cfc2 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:51.612772 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9063eb4-cd4f-4a54-8e41-913f60d6cfc2 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:51.613701 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9063eb4-cd4f-4a54-8e41-913f60d6cfc2 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:51.951277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a9063eb4-cd4f-4a54-8e41-913f60d6cfc2 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:51.963944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a9063eb4-cd4f-4a54-8e41-913f60d6cfc2 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1315 microversion: 2.1 time: 0.364922 Jun 30 04:15:52.001706 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 55/99] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:51 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:52.881574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-7f83425b-556d-41e6-82ea-0f61072cf143 req-b416c2b6-b641-4121-8091-4a62dc1b4896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3f3442-a00e-47ee-b0df-f099086628ce", "tag": "bd404336-185f-4a39-8576-5211044a2340"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:52.902372 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-7f83425b-556d-41e6-82ea-0f61072cf143 req-b416c2b6-b641-4121-8091-4a62dc1b4896 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:52.905010 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-7f83425b-556d-41e6-82ea-0f61072cf143 req-b416c2b6-b641-4121-8091-4a62dc1b4896 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:52.942698 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-7f83425b-556d-41e6-82ea-0f61072cf143 req-b416c2b6-b641-4121-8091-4a62dc1b4896 service nova] Creating event network-changed:bd404336-185f-4a39-8576-5211044a2340 for instance 2d3f3442-a00e-47ee-b0df-f099086628ce on hv-cinder-84684 Jun 30 04:15:52.949089 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-7f83425b-556d-41e6-82ea-0f61072cf143 req-b416c2b6-b641-4121-8091-4a62dc1b4896 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073009 Jun 30 04:15:52.950268 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 45/100] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:15:52.982425 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7eb1bd40-1664-4c66-915b-f4e9baea1813 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:15:52.983073 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7eb1bd40-1664-4c66-915b-f4e9baea1813 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:52.994396 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7eb1bd40-1664-4c66-915b-f4e9baea1813 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:52.994852 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7eb1bd40-1664-4c66-915b-f4e9baea1813 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:52.997184 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7eb1bd40-1664-4c66-915b-f4e9baea1813 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:52.997709 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7eb1bd40-1664-4c66-915b-f4e9baea1813 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:53.348696 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7eb1bd40-1664-4c66-915b-f4e9baea1813 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:15:53.369157 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7eb1bd40-1664-4c66-915b-f4e9baea1813 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1502 microversion: 2.1 time: 0.382573 Jun 30 04:15:53.374470 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 56/101] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:15:52 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1502 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:15:57.472040 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-580b0554-4c92-44b3-8ebc-b19f0dbccb80 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa61dd15-7d6c-4d2e-a925-8db0ac23fa04"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:15:57.474554 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-580b0554-4c92-44b3-8ebc-b19f0dbccb80 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:15:57.482008 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-580b0554-4c92-44b3-8ebc-b19f0dbccb80 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:57.482449 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-580b0554-4c92-44b3-8ebc-b19f0dbccb80 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:57.483781 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-580b0554-4c92-44b3-8ebc-b19f0dbccb80 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:15:57.484521 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-580b0554-4c92-44b3-8ebc-b19f0dbccb80 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:15:58.406616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-580b0554-4c92-44b3-8ebc-b19f0dbccb80 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "POST /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938206 Jun 30 04:15:58.408637 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 46/102] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:15:57 2022] POST /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:16:03.092342 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1326458916", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "networks": [{"uuid": "e32b4d2d-0c44-4263-befe-fe39be6c48e5"}]}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:03.130747 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=23 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:03.206772 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] validate_networks() for [('e32b4d2d-0c44-4263-befe-fe39be6c48e5', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:16:03.354073 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=50 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:04.207602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:16:04.208192 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:16:04.208490 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:16:04.208899 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:16:04.209311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:16:04.219640 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:04.220086 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:04.220883 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:04.221313 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:04.244703 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Getting quotas for project 94100e07e4d34a679ae537cb87de4dba. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:16:04.249067 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Getting quotas for user 787ef24488804250a58038c7378623ae and project 94100e07e4d34a679ae537cb87de4dba. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:16:04.261047 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:16:04.264242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:16:04.335254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-03b68f00-05dd-4b7f-9bbd-9d99494b3494 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247296 Jun 30 04:16:04.341485 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 57/103] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:16:04.349929 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2728cac1-a18d-4b2b-b55a-e25feeac31ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:04.351546 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2728cac1-a18d-4b2b-b55a-e25feeac31ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:04.499962 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2728cac1-a18d-4b2b-b55a-e25feeac31ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:04.517157 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2728cac1-a18d-4b2b-b55a-e25feeac31ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1214 microversion: 2.1 time: 0.173731 Jun 30 04:16:04.526920 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 47/104] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:04 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:05.534602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b4bb2fdb-d3aa-4fe8-aeb1-7daf7c9758db tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:05.536589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b4bb2fdb-d3aa-4fe8-aeb1-7daf7c9758db tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:05.543578 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b4bb2fdb-d3aa-4fe8-aeb1-7daf7c9758db tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:05.544936 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b4bb2fdb-d3aa-4fe8-aeb1-7daf7c9758db tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:05.546228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b4bb2fdb-d3aa-4fe8-aeb1-7daf7c9758db tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:05.547082 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b4bb2fdb-d3aa-4fe8-aeb1-7daf7c9758db tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:05.632070 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b4bb2fdb-d3aa-4fe8-aeb1-7daf7c9758db tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:05.641161 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b4bb2fdb-d3aa-4fe8-aeb1-7daf7c9758db tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1218 microversion: 2.1 time: 0.110683 Jun 30 04:16:05.641840 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 58/105] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:05 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:06.660333 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f59ac543-cf6a-411d-b529-c272b287b4e4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:06.661181 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f59ac543-cf6a-411d-b529-c272b287b4e4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:06.678641 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=40 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:06.683814 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f59ac543-cf6a-411d-b529-c272b287b4e4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:06.684201 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f59ac543-cf6a-411d-b529-c272b287b4e4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:06.685322 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f59ac543-cf6a-411d-b529-c272b287b4e4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:06.685859 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f59ac543-cf6a-411d-b529-c272b287b4e4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:06.772799 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f59ac543-cf6a-411d-b529-c272b287b4e4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:06.784166 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f59ac543-cf6a-411d-b529-c272b287b4e4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1266 microversion: 2.1 time: 0.128550 Jun 30 04:16:06.785413 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 48/106] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:06 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:07.640592 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9aa749f2-211f-4000-b6a6-8125083cda71 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:07.641101 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9aa749f2-211f-4000-b6a6-8125083cda71 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:07.651441 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9aa749f2-211f-4000-b6a6-8125083cda71 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:07.655763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9aa749f2-211f-4000-b6a6-8125083cda71 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:07.658665 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9aa749f2-211f-4000-b6a6-8125083cda71 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:07.659182 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9aa749f2-211f-4000-b6a6-8125083cda71 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:07.718387 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9aa749f2-211f-4000-b6a6-8125083cda71 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:16:07.801953 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f8312198-906f-4856-b3cc-bee614fe14a7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:07.803219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f8312198-906f-4856-b3cc-bee614fe14a7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:07.815467 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8312198-906f-4856-b3cc-bee614fe14a7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:07.817155 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8312198-906f-4856-b3cc-bee614fe14a7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:07.819451 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8312198-906f-4856-b3cc-bee614fe14a7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:07.822900 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8312198-906f-4856-b3cc-bee614fe14a7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:07.966151 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f8312198-906f-4856-b3cc-bee614fe14a7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:07.974987 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f8312198-906f-4856-b3cc-bee614fe14a7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1272 microversion: 2.1 time: 0.176842 Jun 30 04:16:07.982106 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 49/107] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:07 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:16:08.012196 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9aa749f2-211f-4000-b6a6-8125083cda71 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "DELETE /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 204 len: 0 microversion: 2.1 time: 0.373882 Jun 30 04:16:08.017779 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 59/108] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:16:07 2022] DELETE /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 04:16:08.025564 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9b92eeea-3c57-4848-86b7-6d98e1a330fe tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:08.026505 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9b92eeea-3c57-4848-86b7-6d98e1a330fe tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:08.041989 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b92eeea-3c57-4848-86b7-6d98e1a330fe tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:08.042722 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b92eeea-3c57-4848-86b7-6d98e1a330fe tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:08.043806 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b92eeea-3c57-4848-86b7-6d98e1a330fe tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:08.044520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b92eeea-3c57-4848-86b7-6d98e1a330fe tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:08.364985 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9b92eeea-3c57-4848-86b7-6d98e1a330fe tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:08.377705 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9b92eeea-3c57-4848-86b7-6d98e1a330fe tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1554 microversion: 2.1 time: 0.355567 Jun 30 04:16:08.378722 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 50/109] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:08 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1554 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:09.002072 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-dcec56a7-1d4f-4455-b9fe-c8b71f463f74 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:09.002772 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-dcec56a7-1d4f-4455-b9fe-c8b71f463f74 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:09.011877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dcec56a7-1d4f-4455-b9fe-c8b71f463f74 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:09.012971 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dcec56a7-1d4f-4455-b9fe-c8b71f463f74 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:09.017006 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dcec56a7-1d4f-4455-b9fe-c8b71f463f74 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:09.017459 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dcec56a7-1d4f-4455-b9fe-c8b71f463f74 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:09.194581 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-dcec56a7-1d4f-4455-b9fe-c8b71f463f74 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:09.202987 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-dcec56a7-1d4f-4455-b9fe-c8b71f463f74 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1314 microversion: 2.1 time: 0.206661 Jun 30 04:16:09.203963 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 60/110] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:08 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:09.398556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-97411cf3-ba62-458c-866c-dc60b03bf657 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:09.399272 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-97411cf3-ba62-458c-866c-dc60b03bf657 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:09.411954 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97411cf3-ba62-458c-866c-dc60b03bf657 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:09.412406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97411cf3-ba62-458c-866c-dc60b03bf657 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:09.413184 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97411cf3-ba62-458c-866c-dc60b03bf657 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:09.414686 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97411cf3-ba62-458c-866c-dc60b03bf657 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:09.745054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-97411cf3-ba62-458c-866c-dc60b03bf657 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:09.760068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-97411cf3-ba62-458c-866c-dc60b03bf657 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1554 microversion: 2.1 time: 0.367537 Jun 30 04:16:09.761358 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 51/111] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:09 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1554 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:10.221524 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-85b06d1b-4869-4cab-b52a-d408e7b61b0d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:10.223068 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-85b06d1b-4869-4cab-b52a-d408e7b61b0d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:10.244446 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-85b06d1b-4869-4cab-b52a-d408e7b61b0d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:10.246031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-85b06d1b-4869-4cab-b52a-d408e7b61b0d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:10.247564 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-85b06d1b-4869-4cab-b52a-d408e7b61b0d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:10.248662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-85b06d1b-4869-4cab-b52a-d408e7b61b0d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:10.777467 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-41e00bf3-619f-4e5a-877d-6045939d51de tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:10.778290 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-41e00bf3-619f-4e5a-877d-6045939d51de tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:10.786402 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-41e00bf3-619f-4e5a-877d-6045939d51de tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:10.787138 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-41e00bf3-619f-4e5a-877d-6045939d51de tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:10.788016 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-41e00bf3-619f-4e5a-877d-6045939d51de tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:10.788630 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-41e00bf3-619f-4e5a-877d-6045939d51de tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:10.793290 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:11.198313 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-85b06d1b-4869-4cab-b52a-d408e7b61b0d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:11.208004 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-85b06d1b-4869-4cab-b52a-d408e7b61b0d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1314 microversion: 2.1 time: 0.991351 Jun 30 04:16:11.208598 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 61/112] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:10 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1314 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:11.229430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-41e00bf3-619f-4e5a-877d-6045939d51de tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:11.238742 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-41e00bf3-619f-4e5a-877d-6045939d51de tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1554 microversion: 2.1 time: 0.465519 Jun 30 04:16:11.243903 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 52/113] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:10 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1554 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:11.578040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-b19354e2-7250-45e0-9a05-67c12ac572aa req-70be9e20-0d5b-465b-83f6-22922cbe1180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ceac9b-808a-455a-9409-817a9675cc84", "name": "network-vif-deleted", "tag": "7cff6837-1499-4d0c-af41-27acd223363c"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:11.594117 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-b19354e2-7250-45e0-9a05-67c12ac572aa req-70be9e20-0d5b-465b-83f6-22922cbe1180 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:11.594971 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-b19354e2-7250-45e0-9a05-67c12ac572aa req-70be9e20-0d5b-465b-83f6-22922cbe1180 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:11.613144 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-b19354e2-7250-45e0-9a05-67c12ac572aa req-70be9e20-0d5b-465b-83f6-22922cbe1180 service nova] Creating event network-vif-deleted:7cff6837-1499-4d0c-af41-27acd223363c for instance 43ceac9b-808a-455a-9409-817a9675cc84 on hv-cinder-84684 Jun 30 04:16:11.621183 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-b19354e2-7250-45e0-9a05-67c12ac572aa req-70be9e20-0d5b-465b-83f6-22922cbe1180 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048450 Jun 30 04:16:11.621837 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 62/114] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:16:12.225025 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b9cf5602-7d78-4e63-b9d1-58ae7c3b459a tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:12.225644 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b9cf5602-7d78-4e63-b9d1-58ae7c3b459a tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:12.232517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9cf5602-7d78-4e63-b9d1-58ae7c3b459a tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:12.232953 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9cf5602-7d78-4e63-b9d1-58ae7c3b459a tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:12.233709 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9cf5602-7d78-4e63-b9d1-58ae7c3b459a tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:12.234129 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9cf5602-7d78-4e63-b9d1-58ae7c3b459a tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:12.262035 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-451baa86-8c36-4f56-a539-a51903481232 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:12.262929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-451baa86-8c36-4f56-a539-a51903481232 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:12.271639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-451baa86-8c36-4f56-a539-a51903481232 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:12.272267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-451baa86-8c36-4f56-a539-a51903481232 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:12.274171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-451baa86-8c36-4f56-a539-a51903481232 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:12.274947 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-451baa86-8c36-4f56-a539-a51903481232 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:12.362564 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-451baa86-8c36-4f56-a539-a51903481232 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:12.372005 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-451baa86-8c36-4f56-a539-a51903481232 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1512 microversion: 2.1 time: 0.114932 Jun 30 04:16:12.372956 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 63/115] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:12 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1512 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:12.407267 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b9cf5602-7d78-4e63-b9d1-58ae7c3b459a tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:12.415405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b9cf5602-7d78-4e63-b9d1-58ae7c3b459a tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1314 microversion: 2.1 time: 0.194264 Jun 30 04:16:12.416311 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 53/116] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:12 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:13.389608 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d4a1782b-e878-45ac-b615-6f60baa77775 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:13.390279 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d4a1782b-e878-45ac-b615-6f60baa77775 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:13.396921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d4a1782b-e878-45ac-b615-6f60baa77775 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:13.397373 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d4a1782b-e878-45ac-b615-6f60baa77775 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:13.398081 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d4a1782b-e878-45ac-b615-6f60baa77775 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:13.398863 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d4a1782b-e878-45ac-b615-6f60baa77775 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:13.434259 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0b9e272e-5e90-4f47-8d3b-5d57c0dbb6b0 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:13.435030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0b9e272e-5e90-4f47-8d3b-5d57c0dbb6b0 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:13.442210 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b9e272e-5e90-4f47-8d3b-5d57c0dbb6b0 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:13.442725 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b9e272e-5e90-4f47-8d3b-5d57c0dbb6b0 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:13.443670 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b9e272e-5e90-4f47-8d3b-5d57c0dbb6b0 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:13.444161 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b9e272e-5e90-4f47-8d3b-5d57c0dbb6b0 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:13.475868 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d4a1782b-e878-45ac-b615-6f60baa77775 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:13.485097 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d4a1782b-e878-45ac-b615-6f60baa77775 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1346 microversion: 2.1 time: 0.099759 Jun 30 04:16:13.485691 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 64/117] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:13 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:13.616604 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0b9e272e-5e90-4f47-8d3b-5d57c0dbb6b0 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:13.625642 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0b9e272e-5e90-4f47-8d3b-5d57c0dbb6b0 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1314 microversion: 2.1 time: 0.196908 Jun 30 04:16:13.626256 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 54/118] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:13 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:16:13.641456 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-b900b1ea-a013-4d7f-ad35-9a05edaee2ca req-b4f1dab3-28fe-498f-b6b9-5ce73e667f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "504967a1-62e0-47c1-afe0-4aca8879a2c8", "tag": "4f3fd811-7ab9-4ad8-99a4-684d8dc134bf"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:13.650776 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-b900b1ea-a013-4d7f-ad35-9a05edaee2ca req-b4f1dab3-28fe-498f-b6b9-5ce73e667f8a service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:13.651235 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-b900b1ea-a013-4d7f-ad35-9a05edaee2ca req-b4f1dab3-28fe-498f-b6b9-5ce73e667f8a service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:13.662914 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-b900b1ea-a013-4d7f-ad35-9a05edaee2ca req-b4f1dab3-28fe-498f-b6b9-5ce73e667f8a service nova] Creating event network-changed:4f3fd811-7ab9-4ad8-99a4-684d8dc134bf for instance 504967a1-62e0-47c1-afe0-4aca8879a2c8 on hv-cinder-84684 Jun 30 04:16:13.667678 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-b900b1ea-a013-4d7f-ad35-9a05edaee2ca req-b4f1dab3-28fe-498f-b6b9-5ce73e667f8a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031250 Jun 30 04:16:13.668270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 65/119] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:16:14.501855 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:14.502447 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:14.509330 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:14.509778 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:14.510542 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:14.510968 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:14.516408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:14.543402 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:14.543862 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:14.544435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lazy-loading 'fault' on Instance uuid 43ceac9b-808a-455a-9409-817a9675cc84 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:16:14.590219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392b8ea4f0c6480d9eb65ce93ec3e719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a37f11a6f794a518cfcfa600caf2445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:14.598830 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7ad43e61-5716-4113-bda4-b1bfe71cbdca tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 200 len: 1351 microversion: 2.1 time: 0.100871 Jun 30 04:16:14.599659 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 55/120] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:14 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:14.639137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:14.639848 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=6 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:14.644440 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-da554701-1d85-41ec-b2ce-cd8a8be29e5f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:14.645247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-da554701-1d85-41ec-b2ce-cd8a8be29e5f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:14.653075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-da554701-1d85-41ec-b2ce-cd8a8be29e5f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:14.653517 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-da554701-1d85-41ec-b2ce-cd8a8be29e5f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:14.654441 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-da554701-1d85-41ec-b2ce-cd8a8be29e5f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:14.654866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-da554701-1d85-41ec-b2ce-cd8a8be29e5f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:14.822342 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-da554701-1d85-41ec-b2ce-cd8a8be29e5f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:14.830687 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-da554701-1d85-41ec-b2ce-cd8a8be29e5f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1314 microversion: 2.1 time: 0.190741 Jun 30 04:16:14.831681 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 66/121] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:14 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:15.616313 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-899679d3-99b8-42be-bdee-a7200c91f972 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:15.617046 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-899679d3-99b8-42be-bdee-a7200c91f972 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:15.624570 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-899679d3-99b8-42be-bdee-a7200c91f972 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:15.625006 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-899679d3-99b8-42be-bdee-a7200c91f972 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:15.625763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-899679d3-99b8-42be-bdee-a7200c91f972 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:15.626186 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-899679d3-99b8-42be-bdee-a7200c91f972 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:15.642140 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-899679d3-99b8-42be-bdee-a7200c91f972 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] HTTP exception thrown: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-899679d3-99b8-42be-bdee-a7200c91f972 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Request method failure captured: Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 HTTP/1.1 Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSNQC__E10kfagCW1z_F-Q2DfGo6Dz4TUHJqHFcEe0TvvS3tXg9tQILI-ochFAVgOzTSv_4bvbvbsSxKtRfHAOfT6WnY6lvLrz6gQCZwqfsuRv_9MdhMy6oh0Jung_bs45tCB_5Zf-LK22pmFBy_uBgcm504U4wiOXoHut27M-bRUHM Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 6a37f11a6f794a518cfcfa600caf2445 Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:16:15.646911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6a37f11a6f794a518cfcfa600caf2445"}]}] Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 6a37f11a6f794a518cfcfa600caf2445 Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-DeleteServersTestJSON-486871242-project Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: 392b8ea4f0c6480d9eb65ce93ec3e719 Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-DeleteServersTestJSON-486871242-project Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:15.648391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '43ceac9b-808a-455a-9409-817a9675cc84'} Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:16:15.649134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:15.650408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:16:15.651608 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-899679d3-99b8-42be-bdee-a7200c91f972 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Returning 404 to user: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:16:15.651608 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-899679d3-99b8-42be-bdee-a7200c91f972 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 404 len: 111 microversion: 2.1 time: 0.036033 Jun 30 04:16:15.655011 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 56/122] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:15 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:16:15.761636 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-34c1e6cf-a7b1-490f-aa8d-5f7e9b489c90 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:15.762659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-34c1e6cf-a7b1-490f-aa8d-5f7e9b489c90 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:15.769126 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-34c1e6cf-a7b1-490f-aa8d-5f7e9b489c90 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:15.769594 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-34c1e6cf-a7b1-490f-aa8d-5f7e9b489c90 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:15.770341 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-34c1e6cf-a7b1-490f-aa8d-5f7e9b489c90 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:15.770809 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-34c1e6cf-a7b1-490f-aa8d-5f7e9b489c90 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:15.784147 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-34c1e6cf-a7b1-490f-aa8d-5f7e9b489c90 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] HTTP exception thrown: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-34c1e6cf-a7b1-490f-aa8d-5f7e9b489c90 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Request method failure captured: Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84/os-volume_attachments HTTP/1.1 Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSNQC__E10kfagCW1z_F-Q2DfGo6Dz4TUHJqHFcEe0TvvS3tXg9tQILI-ochFAVgOzTSv_4bvbvbsSxKtRfHAOfT6WnY6lvLrz6gQCZwqfsuRv_9MdhMy6oh0Jung_bs45tCB_5Zf-LK22pmFBy_uBgcm504U4wiOXoHut27M-bRUHM Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 6a37f11a6f794a518cfcfa600caf2445 Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:16:15.788877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6a37f11a6f794a518cfcfa600caf2445"}]}] Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 6a37f11a6f794a518cfcfa600caf2445 Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-DeleteServersTestJSON-486871242-project Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: 392b8ea4f0c6480d9eb65ce93ec3e719 Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-DeleteServersTestJSON-486871242-project Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:15.790302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'server_id': '43ceac9b-808a-455a-9409-817a9675cc84'} Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:16:15.791075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:15.792270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:15.793295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-34c1e6cf-a7b1-490f-aa8d-5f7e9b489c90 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Returning 404 to user: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:16:15.793295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-34c1e6cf-a7b1-490f-aa8d-5f7e9b489c90 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032993 Jun 30 04:16:15.793295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 67/123] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:16:15 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:16:15.849366 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c8c22e00-8208-4eb0-8ef1-0a2b91cb4646 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:15.850394 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c8c22e00-8208-4eb0-8ef1-0a2b91cb4646 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:15.856713 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8c22e00-8208-4eb0-8ef1-0a2b91cb4646 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:15.857441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8c22e00-8208-4eb0-8ef1-0a2b91cb4646 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:15.858253 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8c22e00-8208-4eb0-8ef1-0a2b91cb4646 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:15.858651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8c22e00-8208-4eb0-8ef1-0a2b91cb4646 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:16.022361 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c8c22e00-8208-4eb0-8ef1-0a2b91cb4646 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:16.032458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c8c22e00-8208-4eb0-8ef1-0a2b91cb4646 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1314 microversion: 2.1 time: 0.187400 Jun 30 04:16:16.033526 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 57/124] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:15 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:16:17.038660 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5bb2b206-44ee-4356-8e3d-1be4210d67cf tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:17.039315 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5bb2b206-44ee-4356-8e3d-1be4210d67cf tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:17.046689 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5bb2b206-44ee-4356-8e3d-1be4210d67cf tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:17.047215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5bb2b206-44ee-4356-8e3d-1be4210d67cf tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:17.048534 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5bb2b206-44ee-4356-8e3d-1be4210d67cf tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:17.049020 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5bb2b206-44ee-4356-8e3d-1be4210d67cf tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:17.050970 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-24bfaaa2-ae7c-40d8-b76f-3bc8a18c9b5b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:17.051567 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-24bfaaa2-ae7c-40d8-b76f-3bc8a18c9b5b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:17.059389 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24bfaaa2-ae7c-40d8-b76f-3bc8a18c9b5b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:17.060479 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24bfaaa2-ae7c-40d8-b76f-3bc8a18c9b5b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:17.061255 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24bfaaa2-ae7c-40d8-b76f-3bc8a18c9b5b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:17.061680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24bfaaa2-ae7c-40d8-b76f-3bc8a18c9b5b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:17.067006 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-5bb2b206-44ee-4356-8e3d-1be4210d67cf tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] HTTP exception thrown: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5bb2b206-44ee-4356-8e3d-1be4210d67cf tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Request method failure captured: Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: DELETE /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 HTTP/1.1 Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSNQC__E10kfagCW1z_F-Q2DfGo6Dz4TUHJqHFcEe0TvvS3tXg9tQILI-ochFAVgOzTSv_4bvbvbsSxKtRfHAOfT6WnY6lvLrz6gQCZwqfsuRv_9MdhMy6oh0Jung_bs45tCB_5Zf-LK22pmFBy_uBgcm504U4wiOXoHut27M-bRUHM Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 6a37f11a6f794a518cfcfa600caf2445 Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:16:17.069386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6a37f11a6f794a518cfcfa600caf2445"}]}] Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 6a37f11a6f794a518cfcfa600caf2445 Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-DeleteServersTestJSON-486871242-project Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: 392b8ea4f0c6480d9eb65ce93ec3e719 Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-DeleteServersTestJSON-486871242-project Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:17.070639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '43ceac9b-808a-455a-9409-817a9675cc84'} Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:16:17.071478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:17.073254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:17.074300 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5bb2b206-44ee-4356-8e3d-1be4210d67cf tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Returning 404 to user: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:16:17.074300 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5bb2b206-44ee-4356-8e3d-1be4210d67cf tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "DELETE /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 404 len: 111 microversion: 2.1 time: 0.036766 Jun 30 04:16:17.074300 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 68/125] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:16:17 2022] DELETE /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:16:17.080331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7805de04-91ba-4fd1-bbbc-e1673a0550b4 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:17.081095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7805de04-91ba-4fd1-bbbc-e1673a0550b4 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] [instance: 43ceac9b-808a-455a-9409-817a9675cc84] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:17.087943 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7805de04-91ba-4fd1-bbbc-e1673a0550b4 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:17.088631 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7805de04-91ba-4fd1-bbbc-e1673a0550b4 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:17.089545 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7805de04-91ba-4fd1-bbbc-e1673a0550b4 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:17.089991 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7805de04-91ba-4fd1-bbbc-e1673a0550b4 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:17.104505 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-7805de04-91ba-4fd1-bbbc-e1673a0550b4 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] HTTP exception thrown: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7805de04-91ba-4fd1-bbbc-e1673a0550b4 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Request method failure captured: Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 HTTP/1.1 Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSNQC__E10kfagCW1z_F-Q2DfGo6Dz4TUHJqHFcEe0TvvS3tXg9tQILI-ochFAVgOzTSv_4bvbvbsSxKtRfHAOfT6WnY6lvLrz6gQCZwqfsuRv_9MdhMy6oh0Jung_bs45tCB_5Zf-LK22pmFBy_uBgcm504U4wiOXoHut27M-bRUHM Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 6a37f11a6f794a518cfcfa600caf2445 Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:16:17.106298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6a37f11a6f794a518cfcfa600caf2445"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6a37f11a6f794a518cfcfa600caf2445"}]}] Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 6a37f11a6f794a518cfcfa600caf2445 Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-DeleteServersTestJSON-486871242 Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-DeleteServersTestJSON-486871242-project Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: 392b8ea4f0c6480d9eb65ce93ec3e719 Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-DeleteServersTestJSON-486871242-project Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:17.107734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '43ceac9b-808a-455a-9409-817a9675cc84'} Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:16:17.108513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. Jun 30 04:16:17.109972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:17.111148 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7805de04-91ba-4fd1-bbbc-e1673a0550b4 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] Returning 404 to user: Instance 43ceac9b-808a-455a-9409-817a9675cc84 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:16:17.111148 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7805de04-91ba-4fd1-bbbc-e1673a0550b4 tempest-DeleteServersTestJSON-486871242 tempest-DeleteServersTestJSON-486871242-project] 10.222.0.13 "GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84" status: 404 len: 111 microversion: 2.1 time: 0.031517 Jun 30 04:16:17.111148 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 69/126] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:17 2022] GET /compute/v2.1/servers/43ceac9b-808a-455a-9409-817a9675cc84 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 04:16:17.206034 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-24bfaaa2-ae7c-40d8-b76f-3bc8a18c9b5b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:17.213620 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-24bfaaa2-ae7c-40d8-b76f-3bc8a18c9b5b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1314 microversion: 2.1 time: 0.166756 Jun 30 04:16:17.214196 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 58/127] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:17 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:17.788808 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-2ecb74c9-4ce7-4975-ae3e-af0b1cbbfb6c req-f6ee5311-4a5d-4c13-aa39-35b106535661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504967a1-62e0-47c1-afe0-4aca8879a2c8", "name": "network-vif-plugged", "status": "completed", "tag": "4f3fd811-7ab9-4ad8-99a4-684d8dc134bf"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:17.801949 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-2ecb74c9-4ce7-4975-ae3e-af0b1cbbfb6c req-f6ee5311-4a5d-4c13-aa39-35b106535661 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:17.803423 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-2ecb74c9-4ce7-4975-ae3e-af0b1cbbfb6c req-f6ee5311-4a5d-4c13-aa39-35b106535661 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:17.825081 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-2ecb74c9-4ce7-4975-ae3e-af0b1cbbfb6c req-f6ee5311-4a5d-4c13-aa39-35b106535661 service nova] Creating event network-vif-plugged:4f3fd811-7ab9-4ad8-99a4-684d8dc134bf for instance 504967a1-62e0-47c1-afe0-4aca8879a2c8 on hv-cinder-84684 Jun 30 04:16:17.832436 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-2ecb74c9-4ce7-4975-ae3e-af0b1cbbfb6c req-f6ee5311-4a5d-4c13-aa39-35b106535661 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047874 Jun 30 04:16:17.845639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 70/128] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:16:18.231776 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e6a87413-d002-4969-a396-76ac823ed3ff tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:18.234177 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e6a87413-d002-4969-a396-76ac823ed3ff tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:18.242713 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e6a87413-d002-4969-a396-76ac823ed3ff tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:18.243435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e6a87413-d002-4969-a396-76ac823ed3ff tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:18.244619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e6a87413-d002-4969-a396-76ac823ed3ff tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:18.245546 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e6a87413-d002-4969-a396-76ac823ed3ff tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:18.438561 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e6a87413-d002-4969-a396-76ac823ed3ff tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:18.449336 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e6a87413-d002-4969-a396-76ac823ed3ff tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1314 microversion: 2.1 time: 0.222332 Jun 30 04:16:18.450707 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 59/129] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:18 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:19.468822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9ffef4de-44ee-47f0-a3e4-56be88a83ff8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:19.470119 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9ffef4de-44ee-47f0-a3e4-56be88a83ff8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:19.481487 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9ffef4de-44ee-47f0-a3e4-56be88a83ff8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:19.482290 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9ffef4de-44ee-47f0-a3e4-56be88a83ff8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:19.482660 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9ffef4de-44ee-47f0-a3e4-56be88a83ff8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:19.483085 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9ffef4de-44ee-47f0-a3e4-56be88a83ff8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:19.792992 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9ffef4de-44ee-47f0-a3e4-56be88a83ff8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:19.803255 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9ffef4de-44ee-47f0-a3e4-56be88a83ff8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1314 microversion: 2.1 time: 0.339396 Jun 30 04:16:19.805183 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 71/130] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:19 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:20.821068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6400ead2-4553-44c5-87a8-d51585aafcfe tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:20.822331 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6400ead2-4553-44c5-87a8-d51585aafcfe tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:20.832387 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6400ead2-4553-44c5-87a8-d51585aafcfe tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:20.838419 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6400ead2-4553-44c5-87a8-d51585aafcfe tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:20.839715 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6400ead2-4553-44c5-87a8-d51585aafcfe tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:20.840363 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6400ead2-4553-44c5-87a8-d51585aafcfe tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:21.272887 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6400ead2-4553-44c5-87a8-d51585aafcfe tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:21.286557 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6400ead2-4553-44c5-87a8-d51585aafcfe tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1497 microversion: 2.1 time: 0.467351 Jun 30 04:16:21.289070 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 60/131] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:20 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1497 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:22.009035 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3338e430-0a38-4ef5-851d-fdb4e974501f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:22.010610 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3338e430-0a38-4ef5-851d-fdb4e974501f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:22.018051 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3338e430-0a38-4ef5-851d-fdb4e974501f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:22.018491 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3338e430-0a38-4ef5-851d-fdb4e974501f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:22.019295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3338e430-0a38-4ef5-851d-fdb4e974501f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:22.020490 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3338e430-0a38-4ef5-851d-fdb4e974501f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:22.080679 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3338e430-0a38-4ef5-851d-fdb4e974501f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:16:22.261076 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3338e430-0a38-4ef5-851d-fdb4e974501f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "DELETE /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 204 len: 0 microversion: 2.1 time: 0.258166 Jun 30 04:16:22.262384 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 72/132] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:16:22 2022] DELETE /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:16:22.276565 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-84a6a69e-35e4-46e7-b0be-ae7f52651410 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:22.278583 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-84a6a69e-35e4-46e7-b0be-ae7f52651410 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:22.295585 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-84a6a69e-35e4-46e7-b0be-ae7f52651410 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:22.296330 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-84a6a69e-35e4-46e7-b0be-ae7f52651410 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:22.298058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-84a6a69e-35e4-46e7-b0be-ae7f52651410 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:22.298914 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-84a6a69e-35e4-46e7-b0be-ae7f52651410 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:22.501973 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-84a6a69e-35e4-46e7-b0be-ae7f52651410 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:22.510397 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-84a6a69e-35e4-46e7-b0be-ae7f52651410 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1503 microversion: 2.1 time: 0.242994 Jun 30 04:16:22.511051 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 61/133] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:22 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:23.529016 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-39fb06c3-4bbe-4936-8033-52d844e45124 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:23.529681 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-39fb06c3-4bbe-4936-8033-52d844e45124 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:23.544617 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-39fb06c3-4bbe-4936-8033-52d844e45124 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:23.545060 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-39fb06c3-4bbe-4936-8033-52d844e45124 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:23.545810 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-39fb06c3-4bbe-4936-8033-52d844e45124 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:23.546226 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-39fb06c3-4bbe-4936-8033-52d844e45124 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:23.773905 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-39fb06c3-4bbe-4936-8033-52d844e45124 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:23.797260 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-39fb06c3-4bbe-4936-8033-52d844e45124 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 200 len: 1503 microversion: 2.1 time: 0.272540 Jun 30 04:16:23.807769 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 73/134] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:23 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:24.242600 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-3f1ad288-6620-449d-b0e9-1f906c7d5440 req-53d47e8c-2a40-4502-a277-05d260352029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504967a1-62e0-47c1-afe0-4aca8879a2c8", "name": "network-vif-deleted", "tag": "4f3fd811-7ab9-4ad8-99a4-684d8dc134bf"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:24.256825 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-3f1ad288-6620-449d-b0e9-1f906c7d5440 req-53d47e8c-2a40-4502-a277-05d260352029 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:24.257224 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-3f1ad288-6620-449d-b0e9-1f906c7d5440 req-53d47e8c-2a40-4502-a277-05d260352029 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:24.271222 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-3f1ad288-6620-449d-b0e9-1f906c7d5440 req-53d47e8c-2a40-4502-a277-05d260352029 service nova] Creating event network-vif-deleted:4f3fd811-7ab9-4ad8-99a4-684d8dc134bf for instance 504967a1-62e0-47c1-afe0-4aca8879a2c8 on hv-cinder-84684 Jun 30 04:16:24.278486 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-3f1ad288-6620-449d-b0e9-1f906c7d5440 req-53d47e8c-2a40-4502-a277-05d260352029 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039798 Jun 30 04:16:24.279963 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 62/135] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:16:24.816419 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-995ffa8e-1970-4c79-b532-bd1a61b92db4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:24.817844 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-995ffa8e-1970-4c79-b532-bd1a61b92db4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 504967a1-62e0-47c1-afe0-4aca8879a2c8] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:24.824244 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-995ffa8e-1970-4c79-b532-bd1a61b92db4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:24.825266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-995ffa8e-1970-4c79-b532-bd1a61b92db4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:24.827432 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-995ffa8e-1970-4c79-b532-bd1a61b92db4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:24.828160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-995ffa8e-1970-4c79-b532-bd1a61b92db4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:24.844737 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-995ffa8e-1970-4c79-b532-bd1a61b92db4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] HTTP exception thrown: Instance 504967a1-62e0-47c1-afe0-4aca8879a2c8 could not be found. Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-995ffa8e-1970-4c79-b532-bd1a61b92db4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Request method failure captured: Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 HTTP/1.1 Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSOBQzUx95A0zV2yVvq6hTgFogepjdvr_X1V4goNqC2OK-wq3e4G1z7n7wOLW2YKsGDAWnuufhT_YzR1fbyh46bmq0F-DHlhmznXyIr3uEeApGc8x7xZJTkXOvWxVAhuFf8vR-91MrU63G23wsz_9t_nORAQLqTYu26KExFKxNFDLlo Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 94100e07e4d34a679ae537cb87de4dba Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-VolumesActionsTest-91720519 Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:16:24.846538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94100e07e4d34a679ae537cb87de4dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94100e07e4d34a679ae537cb87de4dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94100e07e4d34a679ae537cb87de4dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94100e07e4d34a679ae537cb87de4dba"}]}] Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-VolumesActionsTest-91720519 Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 94100e07e4d34a679ae537cb87de4dba Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-VolumesActionsTest-91720519 Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-VolumesActionsTest-91720519-project Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: 787ef24488804250a58038c7378623ae Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-VolumesActionsTest-91720519-project Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 504967a1-62e0-47c1-afe0-4aca8879a2c8 could not be found. Jun 30 04:16:24.847849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '504967a1-62e0-47c1-afe0-4aca8879a2c8'} Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 504967a1-62e0-47c1-afe0-4aca8879a2c8 could not be found. Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:16:24.848516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 504967a1-62e0-47c1-afe0-4aca8879a2c8 could not be found. Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 504967a1-62e0-47c1-afe0-4aca8879a2c8 could not be found. Jun 30 04:16:24.849644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:24.851995 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-995ffa8e-1970-4c79-b532-bd1a61b92db4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Returning 404 to user: Instance 504967a1-62e0-47c1-afe0-4aca8879a2c8 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:16:24.854071 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-995ffa8e-1970-4c79-b532-bd1a61b92db4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8" status: 404 len: 111 microversion: 2.1 time: 0.041750 Jun 30 04:16:24.855282 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 74/136] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:24 2022] GET /compute/v2.1/servers/504967a1-62e0-47c1-afe0-4aca8879a2c8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:16:25.110333 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-15869684", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "networks": [{"uuid": "e32b4d2d-0c44-4263-befe-fe39be6c48e5"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:25.180279 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] validate_networks() for [('e32b4d2d-0c44-4263-befe-fe39be6c48e5', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:16:25.733119 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:16:25.733724 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:16:25.733987 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:16:25.734385 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:16:25.734790 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:16:25.756333 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:25.757795 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:25.758572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:25.759035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:25.792516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Getting quotas for project 94100e07e4d34a679ae537cb87de4dba. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:16:25.797244 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Getting quotas for user 787ef24488804250a58038c7378623ae and project 94100e07e4d34a679ae537cb87de4dba. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:16:25.812061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:16:25.815312 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:16:25.876875 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fea463cd-b213-44a4-9a32-7aec7bab4bda tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771210 Jun 30 04:16:25.887720 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 63/137] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:16:25.893866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a182883a-92cd-4d95-8230-22658b4e119b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:25.894879 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a182883a-92cd-4d95-8230-22658b4e119b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:26.032261 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a182883a-92cd-4d95-8230-22658b4e119b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:26.039547 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a182883a-92cd-4d95-8230-22658b4e119b tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1212 microversion: 2.1 time: 0.149820 Jun 30 04:16:26.039993 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 75/138] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:25 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1212 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:27.071379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b4eef7b4-8e5d-4eb8-9ab8-fced8b508c9e tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:27.072948 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b4eef7b4-8e5d-4eb8-9ab8-fced8b508c9e tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:27.086468 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b4eef7b4-8e5d-4eb8-9ab8-fced8b508c9e tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:27.090268 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b4eef7b4-8e5d-4eb8-9ab8-fced8b508c9e tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:27.091442 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b4eef7b4-8e5d-4eb8-9ab8-fced8b508c9e tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:27.092906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b4eef7b4-8e5d-4eb8-9ab8-fced8b508c9e tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:27.299324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b4eef7b4-8e5d-4eb8-9ab8-fced8b508c9e tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:27.318574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b4eef7b4-8e5d-4eb8-9ab8-fced8b508c9e tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1208 microversion: 2.1 time: 0.252638 Jun 30 04:16:27.328451 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 64/139] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:27 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1208 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:28.346204 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-82f32a61-bca8-44b5-8932-2e3d8417f9ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:28.359890 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-82f32a61-bca8-44b5-8932-2e3d8417f9ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:28.376654 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-82f32a61-bca8-44b5-8932-2e3d8417f9ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:28.377454 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-82f32a61-bca8-44b5-8932-2e3d8417f9ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:28.378704 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-82f32a61-bca8-44b5-8932-2e3d8417f9ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:28.379755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-82f32a61-bca8-44b5-8932-2e3d8417f9ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:28.422036 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:28.910333 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-82f32a61-bca8-44b5-8932-2e3d8417f9ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:28.924131 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-82f32a61-bca8-44b5-8932-2e3d8417f9ab tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1270 microversion: 2.1 time: 0.590283 Jun 30 04:16:28.925314 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 76/140] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:28 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1270 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:29.596803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1bb48927-09ca-4ddb-95e8-aca6d4aada65 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:29.597359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1bb48927-09ca-4ddb-95e8-aca6d4aada65 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:29.614695 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1bb48927-09ca-4ddb-95e8-aca6d4aada65 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:29.615501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1bb48927-09ca-4ddb-95e8-aca6d4aada65 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:29.616493 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1bb48927-09ca-4ddb-95e8-aca6d4aada65 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:29.617096 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1bb48927-09ca-4ddb-95e8-aca6d4aada65 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:29.643780 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1bb48927-09ca-4ddb-95e8-aca6d4aada65 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/ips" status: 200 len: 151 microversion: 2.20 time: 0.051995 Jun 30 04:16:29.647168 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 65/141] 10.222.0.13 () {60 vars in 1288 bytes} [Thu Jun 30 04:16:29 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/ips => generated 151 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:16:29.942214 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4b280a49-3a08-4f7c-81bc-cdad35f20696 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:29.943834 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4b280a49-3a08-4f7c-81bc-cdad35f20696 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:29.964081 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b280a49-3a08-4f7c-81bc-cdad35f20696 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:29.964763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b280a49-3a08-4f7c-81bc-cdad35f20696 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:29.965785 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b280a49-3a08-4f7c-81bc-cdad35f20696 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:29.966429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b280a49-3a08-4f7c-81bc-cdad35f20696 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:30.383322 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-858585207", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "networks": [{"uuid": "9c18043c-6376-4ef1-99e0-e3f0031cee26"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:30.426228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4b280a49-3a08-4f7c-81bc-cdad35f20696 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:30.435683 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4b280a49-3a08-4f7c-81bc-cdad35f20696 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1312 microversion: 2.1 time: 0.498061 Jun 30 04:16:30.436605 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 77/142] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:29 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1312 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:31.085671 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-8d8fcdf9-52e0-43a9-89e6-110e4af04f0d req-719dfc18-ede5-4059-b352-180253d1eab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013e6bcd-1dfa-41de-b517-1dd0054ee024", "tag": "82041917-867c-427d-977e-0d948fccb60e"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:31.095576 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-8d8fcdf9-52e0-43a9-89e6-110e4af04f0d req-719dfc18-ede5-4059-b352-180253d1eab6 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:31.096348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-8d8fcdf9-52e0-43a9-89e6-110e4af04f0d req-719dfc18-ede5-4059-b352-180253d1eab6 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:31.108228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-8d8fcdf9-52e0-43a9-89e6-110e4af04f0d req-719dfc18-ede5-4059-b352-180253d1eab6 service nova] Creating event network-changed:82041917-867c-427d-977e-0d948fccb60e for instance 013e6bcd-1dfa-41de-b517-1dd0054ee024 on hv-cinder-84684 Jun 30 04:16:31.114048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-8d8fcdf9-52e0-43a9-89e6-110e4af04f0d req-719dfc18-ede5-4059-b352-180253d1eab6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031878 Jun 30 04:16:31.115215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 78/143] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:16:31.459922 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4d69e6db-30a7-4a40-a6e1-0aeb347712c1 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:31.461107 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4d69e6db-30a7-4a40-a6e1-0aeb347712c1 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:31.478838 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4d69e6db-30a7-4a40-a6e1-0aeb347712c1 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:31.480557 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4d69e6db-30a7-4a40-a6e1-0aeb347712c1 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:31.482594 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4d69e6db-30a7-4a40-a6e1-0aeb347712c1 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:31.483397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4d69e6db-30a7-4a40-a6e1-0aeb347712c1 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:31.836822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4d69e6db-30a7-4a40-a6e1-0aeb347712c1 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:31.846393 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4d69e6db-30a7-4a40-a6e1-0aeb347712c1 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1312 microversion: 2.1 time: 0.396590 Jun 30 04:16:31.847586 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 79/144] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:31 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1312 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:16:31.855987 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fc87f238-ea3e-4840-9c80-8b934701c9c3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:31.856729 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fc87f238-ea3e-4840-9c80-8b934701c9c3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:31.867731 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fc87f238-ea3e-4840-9c80-8b934701c9c3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:31.868417 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fc87f238-ea3e-4840-9c80-8b934701c9c3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:31.869375 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fc87f238-ea3e-4840-9c80-8b934701c9c3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:31.870075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fc87f238-ea3e-4840-9c80-8b934701c9c3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:31.905257 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-fc87f238-ea3e-4840-9c80-8b934701c9c3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lazy-loading 'flavor' on Instance uuid 2d3f3442-a00e-47ee-b0df-f099086628ce {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:16:35.780113 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:35.807128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:36.041346 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:39.637310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=71 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:40.396992 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:41.867415 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:42.081057 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:43.337928 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] validate_networks() for [('9c18043c-6376-4ef1-99e0-e3f0031cee26', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:16:43.514661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fc87f238-ea3e-4840-9c80-8b934701c9c3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "POST /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/action" status: 202 len: 0 microversion: 2.20 time: 11.664516 Jun 30 04:16:43.515443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 80/145] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 30 04:16:31 2022] POST /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/action => generated 0 bytes in 11667 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:16:43.522366 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-40ff1421-6264-4430-917e-6075b6f83e9d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:43.523073 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-40ff1421-6264-4430-917e-6075b6f83e9d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:43.530089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-40ff1421-6264-4430-917e-6075b6f83e9d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:43.530860 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-40ff1421-6264-4430-917e-6075b6f83e9d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:43.532005 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-40ff1421-6264-4430-917e-6075b6f83e9d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:43.532397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-40ff1421-6264-4430-917e-6075b6f83e9d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:43.790647 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-40ff1421-6264-4430-917e-6075b6f83e9d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:43.799065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-40ff1421-6264-4430-917e-6075b6f83e9d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1312 microversion: 2.1 time: 0.282207 Jun 30 04:16:43.804406 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 81/146] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:43 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1312 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:43.977216 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-248015673", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:43.986231 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:16:43.986645 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:16:43.987123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:16:43.987531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:16:43.987925 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:16:43.997197 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:43.997708 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:43.999038 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:43.999038 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:44.017750 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Getting quotas for project 4a5e183a36084c9fb82f3a3f7d24402a. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:16:44.022338 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Getting quotas for user abfd09ef27184291a36b43b6664740c5 and project 4a5e183a36084c9fb82f3a3f7d24402a. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:16:44.035323 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:16:44.037500 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:16:44.041468 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] validate_networks() for [('d053466e-8b12-41f1-8495-352ca2b58558', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:16:44.085765 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f5850b91-dd64-45df-8483-46c7bf0e5fae tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.706895 Jun 30 04:16:44.086411 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 66/147] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:16:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 13708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:16:44.095426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-8b2a5847-fa86-4e1a-a30a-209cd4cec104 req-85475fca-462c-4c8d-96d3-77db28463be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013e6bcd-1dfa-41de-b517-1dd0054ee024", "name": "network-vif-plugged", "status": "completed", "tag": "82041917-867c-427d-977e-0d948fccb60e"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:44.104565 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8b2a5847-fa86-4e1a-a30a-209cd4cec104 req-85475fca-462c-4c8d-96d3-77db28463be6 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:44.105173 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8b2a5847-fa86-4e1a-a30a-209cd4cec104 req-85475fca-462c-4c8d-96d3-77db28463be6 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:44.119368 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-8b2a5847-fa86-4e1a-a30a-209cd4cec104 req-85475fca-462c-4c8d-96d3-77db28463be6 service nova] Creating event network-vif-plugged:82041917-867c-427d-977e-0d948fccb60e for instance 013e6bcd-1dfa-41de-b517-1dd0054ee024 on hv-cinder-84684 Jun 30 04:16:44.128807 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-8b2a5847-fa86-4e1a-a30a-209cd4cec104 req-85475fca-462c-4c8d-96d3-77db28463be6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041200 Jun 30 04:16:44.129419 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 67/148] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:16:44.139703 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-569534444", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:44.223277 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] validate_networks() for None {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:16:44.708212 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:16:44.708954 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:16:44.709049 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:16:44.709461 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:16:44.709896 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:16:44.726277 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:44.726277 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:44.727801 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:44.728340 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:44.749014 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Getting quotas for project 29ec13c3f4a04d688912b49eb43a02e6. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:16:44.753579 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Getting quotas for user 211c1fc524bf4b82b8662fe02748c815 and project 29ec13c3f4a04d688912b49eb43a02e6. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:16:44.764806 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:16:44.767230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:16:44.771529 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:16:44.772063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:16:44.772391 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:16:44.772794 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:16:44.773205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:16:44.783433 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:44.784353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:44.785147 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:44.785559 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:44.802609 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Getting quotas for project 74b53f46d15c4465b9005939114e67a3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:16:44.806539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Getting quotas for user b6854699a1dc475ab11a89bcaf2af85a and project 74b53f46d15c4465b9005939114e67a3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:16:44.810031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-92f50830-67d3-494c-93c9-2e08a4180604 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674479 Jun 30 04:16:44.810718 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 68/149] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:16:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:16:44.815535 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7eb5bcd1-0ce7-4dac-bb80-39092adcfa38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:44.815994 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7eb5bcd1-0ce7-4dac-bb80-39092adcfa38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:44.822383 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7eb5bcd1-0ce7-4dac-bb80-39092adcfa38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:44.822838 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7eb5bcd1-0ce7-4dac-bb80-39092adcfa38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:44.823604 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7eb5bcd1-0ce7-4dac-bb80-39092adcfa38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:44.824022 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7eb5bcd1-0ce7-4dac-bb80-39092adcfa38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:44.824670 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:16:44.827401 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:16:44.895717 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3078dca1-a03a-434b-a0e6-40e7335fd031 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.095012 Jun 30 04:16:44.901213 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 82/150] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:16:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:16:44.901213 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d7f2c001-b8da-48b5-90e0-768a510447eb tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:44.901746 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d7f2c001-b8da-48b5-90e0-768a510447eb tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:44.918150 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d7f2c001-b8da-48b5-90e0-768a510447eb tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:44.918787 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d7f2c001-b8da-48b5-90e0-768a510447eb tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:44.919716 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d7f2c001-b8da-48b5-90e0-768a510447eb tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:44.920553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d7f2c001-b8da-48b5-90e0-768a510447eb tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:44.981790 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7eb5bcd1-0ce7-4dac-bb80-39092adcfa38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:44.991985 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7eb5bcd1-0ce7-4dac-bb80-39092adcfa38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:44.995754 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7eb5bcd1-0ce7-4dac-bb80-39092adcfa38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:45.001691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7eb5bcd1-0ce7-4dac-bb80-39092adcfa38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.189848 Jun 30 04:16:45.004905 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 69/151] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:44 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:16:45.017438 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-97f8e881-1dfb-4070-a030-6eea4561c4c4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:45.018617 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-97f8e881-1dfb-4070-a030-6eea4561c4c4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:45.025079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97f8e881-1dfb-4070-a030-6eea4561c4c4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:45.025800 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97f8e881-1dfb-4070-a030-6eea4561c4c4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:45.026790 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97f8e881-1dfb-4070-a030-6eea4561c4c4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:45.027441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97f8e881-1dfb-4070-a030-6eea4561c4c4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:45.059359 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d7f2c001-b8da-48b5-90e0-768a510447eb tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:45.069613 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d7f2c001-b8da-48b5-90e0-768a510447eb tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1214 microversion: 2.1 time: 0.172045 Jun 30 04:16:45.070561 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 83/152] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:44 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:45.076950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c24e91ee-f9c6-403f-8c94-9010a6ac8351 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:45.077693 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c24e91ee-f9c6-403f-8c94-9010a6ac8351 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:45.154868 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c24e91ee-f9c6-403f-8c94-9010a6ac8351 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:45.180195 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c24e91ee-f9c6-403f-8c94-9010a6ac8351 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1214 microversion: 2.1 time: 0.108185 Jun 30 04:16:45.181523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 84/153] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:45 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:45.186850 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3eed0b0e-877b-4092-afcf-8d2738adbc63 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:45.187698 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3eed0b0e-877b-4092-afcf-8d2738adbc63 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:45.261156 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3eed0b0e-877b-4092-afcf-8d2738adbc63 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:45.271118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3eed0b0e-877b-4092-afcf-8d2738adbc63 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1221 microversion: 2.1 time: 0.088053 Jun 30 04:16:45.272288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 85/154] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:45 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:45.293992 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-97f8e881-1dfb-4070-a030-6eea4561c4c4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:45.303545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-97f8e881-1dfb-4070-a030-6eea4561c4c4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1312 microversion: 2.1 time: 0.297415 Jun 30 04:16:45.314558 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 70/155] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:45 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:45.338931 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-422945769", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:45.404071 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] validate_networks() for [('d053466e-8b12-41f1-8495-352ca2b58558', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:16:45.791081 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:16:45.791687 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:16:45.792000 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:16:45.792406 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:16:45.792811 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:16:45.802681 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:45.803009 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:45.803927 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:45.805322 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:45.823644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Getting quotas for project 74b53f46d15c4465b9005939114e67a3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:16:45.829542 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Getting quotas for user b6854699a1dc475ab11a89bcaf2af85a and project 74b53f46d15c4465b9005939114e67a3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:16:45.845265 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:16:45.847729 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:16:45.895045 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a6b91694-0766-4cac-b757-c7e5fa53aa26 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.560683 Jun 30 04:16:45.896002 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 86/156] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:16:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:16:45.910564 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dc75ab71-dd2a-487c-9749-e8e0d9e038f1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:45.912587 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dc75ab71-dd2a-487c-9749-e8e0d9e038f1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:45.975763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dc75ab71-dd2a-487c-9749-e8e0d9e038f1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:45.982472 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dc75ab71-dd2a-487c-9749-e8e0d9e038f1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1221 microversion: 2.1 time: 0.079524 Jun 30 04:16:45.983039 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 71/157] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:45 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:46.023930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-433418f6-f00c-42d1-ac0f-620f2adf7326 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:46.024660 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-433418f6-f00c-42d1-ac0f-620f2adf7326 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:46.031622 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-433418f6-f00c-42d1-ac0f-620f2adf7326 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:46.032145 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-433418f6-f00c-42d1-ac0f-620f2adf7326 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:46.032961 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-433418f6-f00c-42d1-ac0f-620f2adf7326 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:46.033496 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-433418f6-f00c-42d1-ac0f-620f2adf7326 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:46.087441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-da8a216e-7766-4852-83f6-25c11b5fe798 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:46.088440 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-da8a216e-7766-4852-83f6-25c11b5fe798 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:46.096132 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da8a216e-7766-4852-83f6-25c11b5fe798 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:46.096825 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da8a216e-7766-4852-83f6-25c11b5fe798 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:46.097754 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da8a216e-7766-4852-83f6-25c11b5fe798 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:46.098473 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da8a216e-7766-4852-83f6-25c11b5fe798 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:46.182927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-da8a216e-7766-4852-83f6-25c11b5fe798 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:46.193593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-da8a216e-7766-4852-83f6-25c11b5fe798 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1278 microversion: 2.1 time: 0.111082 Jun 30 04:16:46.194429 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 72/158] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:46 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:46.199319 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-de246a6f-b833-49ce-95a8-3ed41af5d2fc tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:46.199960 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-de246a6f-b833-49ce-95a8-3ed41af5d2fc tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:46.206368 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de246a6f-b833-49ce-95a8-3ed41af5d2fc tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:46.206809 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de246a6f-b833-49ce-95a8-3ed41af5d2fc tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:46.207616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de246a6f-b833-49ce-95a8-3ed41af5d2fc tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:46.208041 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de246a6f-b833-49ce-95a8-3ed41af5d2fc tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:46.224502 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-433418f6-f00c-42d1-ac0f-620f2adf7326 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:46.235151 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-433418f6-f00c-42d1-ac0f-620f2adf7326 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:46.237568 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-433418f6-f00c-42d1-ac0f-620f2adf7326 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:46.239444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-433418f6-f00c-42d1-ac0f-620f2adf7326 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.219432 Jun 30 04:16:46.254976 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 87/159] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:46 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:16:46.301425 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-de246a6f-b833-49ce-95a8-3ed41af5d2fc tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:46.311994 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-de246a6f-b833-49ce-95a8-3ed41af5d2fc tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1266 microversion: 2.1 time: 0.116159 Jun 30 04:16:46.313216 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 73/160] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:46 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:46.324802 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-20cf827c-40dc-4ff7-a1bc-1068ab57a5f8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:46.328321 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-20cf827c-40dc-4ff7-a1bc-1068ab57a5f8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:46.339380 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-20cf827c-40dc-4ff7-a1bc-1068ab57a5f8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:46.341766 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-20cf827c-40dc-4ff7-a1bc-1068ab57a5f8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:46.344578 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-20cf827c-40dc-4ff7-a1bc-1068ab57a5f8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:46.345025 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-20cf827c-40dc-4ff7-a1bc-1068ab57a5f8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:46.525193 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-20cf827c-40dc-4ff7-a1bc-1068ab57a5f8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:46.532833 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-20cf827c-40dc-4ff7-a1bc-1068ab57a5f8 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1495 microversion: 2.1 time: 0.213972 Jun 30 04:16:46.533423 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 88/161] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:46 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1495 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:47.000297 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ead5d4f0-6334-405c-a694-0ace6ad1dd94 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:47.000909 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ead5d4f0-6334-405c-a694-0ace6ad1dd94 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:47.007803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ead5d4f0-6334-405c-a694-0ace6ad1dd94 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.008248 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ead5d4f0-6334-405c-a694-0ace6ad1dd94 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.009014 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ead5d4f0-6334-405c-a694-0ace6ad1dd94 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.009448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ead5d4f0-6334-405c-a694-0ace6ad1dd94 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.111656 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ead5d4f0-6334-405c-a694-0ace6ad1dd94 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:47.119376 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ead5d4f0-6334-405c-a694-0ace6ad1dd94 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1273 microversion: 2.1 time: 0.123006 Jun 30 04:16:47.119944 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 74/162] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:46 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:47.212043 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-98c758a2-588f-4562-97c8-414f0c42277d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:47.212780 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-98c758a2-588f-4562-97c8-414f0c42277d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:47.221804 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98c758a2-588f-4562-97c8-414f0c42277d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.225527 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98c758a2-588f-4562-97c8-414f0c42277d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.226431 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98c758a2-588f-4562-97c8-414f0c42277d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.226955 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98c758a2-588f-4562-97c8-414f0c42277d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.265118 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-29be1b31-22b7-407b-82c7-74b311bc5103 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:47.265677 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-29be1b31-22b7-407b-82c7-74b311bc5103 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:47.273786 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-29be1b31-22b7-407b-82c7-74b311bc5103 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.274364 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-29be1b31-22b7-407b-82c7-74b311bc5103 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.275355 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-29be1b31-22b7-407b-82c7-74b311bc5103 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.275791 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-29be1b31-22b7-407b-82c7-74b311bc5103 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.546572 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-98c758a2-588f-4562-97c8-414f0c42277d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:47.555428 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-98c758a2-588f-4562-97c8-414f0c42277d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1276 microversion: 2.1 time: 0.347095 Jun 30 04:16:47.556669 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 89/163] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:47 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1276 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:47.561782 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c39a2cc1-5bad-404e-a3c3-ea2dae5b1f2d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:47.562604 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c39a2cc1-5bad-404e-a3c3-ea2dae5b1f2d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:47.587450 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c39a2cc1-5bad-404e-a3c3-ea2dae5b1f2d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.588129 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c39a2cc1-5bad-404e-a3c3-ea2dae5b1f2d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.589133 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c39a2cc1-5bad-404e-a3c3-ea2dae5b1f2d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.589823 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c39a2cc1-5bad-404e-a3c3-ea2dae5b1f2d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.628217 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c39a2cc1-5bad-404e-a3c3-ea2dae5b1f2d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:16:47.734034 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c39a2cc1-5bad-404e-a3c3-ea2dae5b1f2d tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "DELETE /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 204 len: 0 microversion: 2.1 time: 0.175761 Jun 30 04:16:47.734672 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 90/164] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:16:47 2022] DELETE /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:16:47.741783 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-919b3e43-f382-4a6f-be14-9f653f6def69 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:47.742743 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-919b3e43-f382-4a6f-be14-9f653f6def69 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:47.749697 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-919b3e43-f382-4a6f-be14-9f653f6def69 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.750384 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-919b3e43-f382-4a6f-be14-9f653f6def69 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.751371 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-919b3e43-f382-4a6f-be14-9f653f6def69 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.751953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-919b3e43-f382-4a6f-be14-9f653f6def69 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.875348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-919b3e43-f382-4a6f-be14-9f653f6def69 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:47.883813 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-919b3e43-f382-4a6f-be14-9f653f6def69 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1272 microversion: 2.1 time: 0.147577 Jun 30 04:16:47.884384 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 91/165] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:47 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:47.889511 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-94cc18d4-e760-48d9-a83a-063370715be4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:47.890847 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-94cc18d4-e760-48d9-a83a-063370715be4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:47.897420 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-94cc18d4-e760-48d9-a83a-063370715be4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.897965 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-94cc18d4-e760-48d9-a83a-063370715be4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:47.898762 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-94cc18d4-e760-48d9-a83a-063370715be4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:47.899214 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-94cc18d4-e760-48d9-a83a-063370715be4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:48.045510 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-29be1b31-22b7-407b-82c7-74b311bc5103 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:48.055051 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-29be1b31-22b7-407b-82c7-74b311bc5103 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:48.056579 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-29be1b31-22b7-407b-82c7-74b311bc5103 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:48.058029 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-29be1b31-22b7-407b-82c7-74b311bc5103 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.798594 Jun 30 04:16:48.058795 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 75/166] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:47 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:16:48.136609 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-14abc81e-fa1b-4ae3-be7e-94812c7a41f9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:48.137212 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-14abc81e-fa1b-4ae3-be7e-94812c7a41f9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:48.143984 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14abc81e-fa1b-4ae3-be7e-94812c7a41f9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:48.144471 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14abc81e-fa1b-4ae3-be7e-94812c7a41f9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:48.145216 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14abc81e-fa1b-4ae3-be7e-94812c7a41f9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:48.145837 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14abc81e-fa1b-4ae3-be7e-94812c7a41f9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:48.247966 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-14abc81e-fa1b-4ae3-be7e-94812c7a41f9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:48.256765 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-94cc18d4-e760-48d9-a83a-063370715be4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:48.257356 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-14abc81e-fa1b-4ae3-be7e-94812c7a41f9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1279 microversion: 2.1 time: 0.124417 Jun 30 04:16:48.258040 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 76/167] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:48 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:16:48.273468 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-94cc18d4-e760-48d9-a83a-063370715be4 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1501 microversion: 2.1 time: 0.387661 Jun 30 04:16:48.274365 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 92/168] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:47 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1501 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:48.573427 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bccacf6d-09ed-409e-a9b6-39925bab6a1d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:48.574044 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bccacf6d-09ed-409e-a9b6-39925bab6a1d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:48.586097 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bccacf6d-09ed-409e-a9b6-39925bab6a1d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:48.586841 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bccacf6d-09ed-409e-a9b6-39925bab6a1d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:48.587813 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bccacf6d-09ed-409e-a9b6-39925bab6a1d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:48.588374 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bccacf6d-09ed-409e-a9b6-39925bab6a1d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:48.790341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bccacf6d-09ed-409e-a9b6-39925bab6a1d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:48.800176 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bccacf6d-09ed-409e-a9b6-39925bab6a1d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.230802 Jun 30 04:16:48.801207 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 77/169] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:48 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:48.902077 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bcb6470e-a650-4eee-b352-6f5edc462c9e tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:48.902907 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-bcb6470e-a650-4eee-b352-6f5edc462c9e tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:48.910765 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bcb6470e-a650-4eee-b352-6f5edc462c9e tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:48.911247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bcb6470e-a650-4eee-b352-6f5edc462c9e tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:48.912011 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bcb6470e-a650-4eee-b352-6f5edc462c9e tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:48.912711 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bcb6470e-a650-4eee-b352-6f5edc462c9e tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:49.079456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0f38d9d4-e88e-49a6-b2c6-11a205487761 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:49.080147 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0f38d9d4-e88e-49a6-b2c6-11a205487761 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:49.090968 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-bcb6470e-a650-4eee-b352-6f5edc462c9e tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:49.111238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0f38d9d4-e88e-49a6-b2c6-11a205487761 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:49.111845 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0f38d9d4-e88e-49a6-b2c6-11a205487761 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:49.116301 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0f38d9d4-e88e-49a6-b2c6-11a205487761 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:49.118161 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0f38d9d4-e88e-49a6-b2c6-11a205487761 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:49.120969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bcb6470e-a650-4eee-b352-6f5edc462c9e tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.214302 Jun 30 04:16:49.131131 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 93/170] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:48 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:49.274763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d65a90aa-5927-4ebc-8ea6-1db2523bba5b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:49.275461 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d65a90aa-5927-4ebc-8ea6-1db2523bba5b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:49.281582 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d65a90aa-5927-4ebc-8ea6-1db2523bba5b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:49.282023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d65a90aa-5927-4ebc-8ea6-1db2523bba5b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:49.282781 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d65a90aa-5927-4ebc-8ea6-1db2523bba5b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:49.283270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d65a90aa-5927-4ebc-8ea6-1db2523bba5b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:49.424003 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d65a90aa-5927-4ebc-8ea6-1db2523bba5b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:49.432584 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d65a90aa-5927-4ebc-8ea6-1db2523bba5b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1279 microversion: 2.1 time: 0.162153 Jun 30 04:16:49.433402 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 94/171] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:49 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:49.440459 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fd47827f-01c5-40ab-bd79-fa5efb0aac89 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:49.441231 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fd47827f-01c5-40ab-bd79-fa5efb0aac89 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:49.449375 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd47827f-01c5-40ab-bd79-fa5efb0aac89 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:49.450050 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd47827f-01c5-40ab-bd79-fa5efb0aac89 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:49.451204 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd47827f-01c5-40ab-bd79-fa5efb0aac89 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:49.451663 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd47827f-01c5-40ab-bd79-fa5efb0aac89 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:49.676808 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0f38d9d4-e88e-49a6-b2c6-11a205487761 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:49.692396 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0f38d9d4-e88e-49a6-b2c6-11a205487761 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:49.693886 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0f38d9d4-e88e-49a6-b2c6-11a205487761 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:49.695134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0f38d9d4-e88e-49a6-b2c6-11a205487761 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.621464 Jun 30 04:16:49.707230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 78/172] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:49 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:16:49.817999 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-673dddec-0d75-4324-84d7-c995918c4fb8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:49.819402 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-673dddec-0d75-4324-84d7-c995918c4fb8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:49.826582 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-673dddec-0d75-4324-84d7-c995918c4fb8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:49.827029 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-673dddec-0d75-4324-84d7-c995918c4fb8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:49.828163 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-673dddec-0d75-4324-84d7-c995918c4fb8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:49.828604 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-673dddec-0d75-4324-84d7-c995918c4fb8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:50.069814 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fd47827f-01c5-40ab-bd79-fa5efb0aac89 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:50.078428 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fd47827f-01c5-40ab-bd79-fa5efb0aac89 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1501 microversion: 2.1 time: 0.643713 Jun 30 04:16:50.079041 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 95/173] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:49 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1501 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:50.141023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-41c0ac96-0592-4d62-bec4-37546f123c16 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:50.141023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-41c0ac96-0592-4d62-bec4-37546f123c16 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:50.145922 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-41c0ac96-0592-4d62-bec4-37546f123c16 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:50.146371 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-41c0ac96-0592-4d62-bec4-37546f123c16 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:50.147165 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-41c0ac96-0592-4d62-bec4-37546f123c16 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:50.147588 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-41c0ac96-0592-4d62-bec4-37546f123c16 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:50.649160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-673dddec-0d75-4324-84d7-c995918c4fb8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:50.657492 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-673dddec-0d75-4324-84d7-c995918c4fb8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.843718 Jun 30 04:16:50.658216 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 79/174] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:49 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:16:50.663380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-37ad854f-54a3-4cc9-b98c-109319238f77 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:50.663986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-37ad854f-54a3-4cc9-b98c-109319238f77 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:50.670354 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37ad854f-54a3-4cc9-b98c-109319238f77 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:50.670789 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37ad854f-54a3-4cc9-b98c-109319238f77 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:50.671760 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37ad854f-54a3-4cc9-b98c-109319238f77 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:50.672188 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37ad854f-54a3-4cc9-b98c-109319238f77 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:50.842456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-37ad854f-54a3-4cc9-b98c-109319238f77 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:50.850183 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-37ad854f-54a3-4cc9-b98c-109319238f77 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1279 microversion: 2.1 time: 0.190651 Jun 30 04:16:50.850759 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 80/175] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:50 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:50.859547 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c08b25a0-eb32-478c-8a40-22380c73c830 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:50.859547 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c08b25a0-eb32-478c-8a40-22380c73c830 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:50.862026 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c08b25a0-eb32-478c-8a40-22380c73c830 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:50.862469 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c08b25a0-eb32-478c-8a40-22380c73c830 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:50.863259 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c08b25a0-eb32-478c-8a40-22380c73c830 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:50.863729 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c08b25a0-eb32-478c-8a40-22380c73c830 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:50.901053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-41c0ac96-0592-4d62-bec4-37546f123c16 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:50.909537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-41c0ac96-0592-4d62-bec4-37546f123c16 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.775287 Jun 30 04:16:50.910088 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 96/176] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:50 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:51.096900 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b858a62e-663c-4932-8631-d403fe7a01a6 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:51.097657 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b858a62e-663c-4932-8631-d403fe7a01a6 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:51.104951 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b858a62e-663c-4932-8631-d403fe7a01a6 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:51.105598 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b858a62e-663c-4932-8631-d403fe7a01a6 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:51.106667 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b858a62e-663c-4932-8631-d403fe7a01a6 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:51.107394 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b858a62e-663c-4932-8631-d403fe7a01a6 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:51.368005 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c08b25a0-eb32-478c-8a40-22380c73c830 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:51.376260 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c08b25a0-eb32-478c-8a40-22380c73c830 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:51.377756 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c08b25a0-eb32-478c-8a40-22380c73c830 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:51.378915 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c08b25a0-eb32-478c-8a40-22380c73c830 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.527231 Jun 30 04:16:51.380200 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 81/177] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:50 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:16:51.644509 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-686db449-6446-46ad-b12c-7102b19362bf req-d4048d5e-ba07-439f-83c2-44f23b8e3cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013e6bcd-1dfa-41de-b517-1dd0054ee024", "name": "network-vif-deleted", "tag": "82041917-867c-427d-977e-0d948fccb60e"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:51.654912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-686db449-6446-46ad-b12c-7102b19362bf req-d4048d5e-ba07-439f-83c2-44f23b8e3cea service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:51.655738 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-686db449-6446-46ad-b12c-7102b19362bf req-d4048d5e-ba07-439f-83c2-44f23b8e3cea service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:51.670840 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-686db449-6446-46ad-b12c-7102b19362bf req-d4048d5e-ba07-439f-83c2-44f23b8e3cea service nova] Creating event network-vif-deleted:82041917-867c-427d-977e-0d948fccb60e for instance 013e6bcd-1dfa-41de-b517-1dd0054ee024 on hv-cinder-84684 Jun 30 04:16:51.676684 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-686db449-6446-46ad-b12c-7102b19362bf req-d4048d5e-ba07-439f-83c2-44f23b8e3cea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037682 Jun 30 04:16:51.677737 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 82/178] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:16:51.679003 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b858a62e-663c-4932-8631-d403fe7a01a6 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:51.686438 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2b8d664f-bfa6-44a4-b8ff-25723f858e76 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:51.688071 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2b8d664f-bfa6-44a4-b8ff-25723f858e76 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:51.693360 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b858a62e-663c-4932-8631-d403fe7a01a6 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1501 microversion: 2.1 time: 0.601394 Jun 30 04:16:51.698285 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 97/179] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:51 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1501 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:16:51.709569 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b8d664f-bfa6-44a4-b8ff-25723f858e76 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:51.710007 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b8d664f-bfa6-44a4-b8ff-25723f858e76 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:51.710778 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b8d664f-bfa6-44a4-b8ff-25723f858e76 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:51.711218 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b8d664f-bfa6-44a4-b8ff-25723f858e76 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:51.868401 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a4dfa923-4d90-4b93-a053-34d78be43a7e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:51.870463 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a4dfa923-4d90-4b93-a053-34d78be43a7e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:51.880321 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a4dfa923-4d90-4b93-a053-34d78be43a7e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:51.881443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a4dfa923-4d90-4b93-a053-34d78be43a7e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:51.882645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a4dfa923-4d90-4b93-a053-34d78be43a7e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:51.884205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a4dfa923-4d90-4b93-a053-34d78be43a7e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:52.121741 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2b8d664f-bfa6-44a4-b8ff-25723f858e76 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:52.136211 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2b8d664f-bfa6-44a4-b8ff-25723f858e76 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.456672 Jun 30 04:16:52.146135 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 83/180] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:51 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:52.146580 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a02a783f-8ead-401e-ba4b-0c4c57159e53 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:52.147219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a02a783f-8ead-401e-ba4b-0c4c57159e53 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:52.169737 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a02a783f-8ead-401e-ba4b-0c4c57159e53 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:52.170255 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a02a783f-8ead-401e-ba4b-0c4c57159e53 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:52.171184 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a02a783f-8ead-401e-ba4b-0c4c57159e53 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:52.171723 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a02a783f-8ead-401e-ba4b-0c4c57159e53 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:52.290422 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a4dfa923-4d90-4b93-a053-34d78be43a7e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:52.300884 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a4dfa923-4d90-4b93-a053-34d78be43a7e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.437243 Jun 30 04:16:52.301806 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 98/181] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:51 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:16:52.309219 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-29c133c9-bf28-488e-9fbe-1a1f4c4f2f9d req-aa7802ba-b3b1-4592-9367-c8637b1dcb35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a789ea-78f4-481d-bd9b-45bce25676ad", "tag": "f7491189-7e96-4247-aee7-3f42f81272cd"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:52.329336 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-29c133c9-bf28-488e-9fbe-1a1f4c4f2f9d req-aa7802ba-b3b1-4592-9367-c8637b1dcb35 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:52.329779 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-29c133c9-bf28-488e-9fbe-1a1f4c4f2f9d req-aa7802ba-b3b1-4592-9367-c8637b1dcb35 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:52.340781 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:52.342696 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-29c133c9-bf28-488e-9fbe-1a1f4c4f2f9d req-aa7802ba-b3b1-4592-9367-c8637b1dcb35 service nova] Creating event network-changed:f7491189-7e96-4247-aee7-3f42f81272cd for instance b9a789ea-78f4-481d-bd9b-45bce25676ad on hv-cinder-84684 Jun 30 04:16:52.355126 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-29c133c9-bf28-488e-9fbe-1a1f4c4f2f9d req-aa7802ba-b3b1-4592-9367-c8637b1dcb35 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050924 Jun 30 04:16:52.355826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 99/182] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:16:52.385195 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a02a783f-8ead-401e-ba4b-0c4c57159e53 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:52.393343 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a02a783f-8ead-401e-ba4b-0c4c57159e53 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.254425 Jun 30 04:16:52.393931 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 84/183] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:52 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:52.399002 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0a3de41c-f6dc-4d31-9ff4-6deb1d6658a0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:52.399846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0a3de41c-f6dc-4d31-9ff4-6deb1d6658a0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:52.407553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0a3de41c-f6dc-4d31-9ff4-6deb1d6658a0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:52.408103 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0a3de41c-f6dc-4d31-9ff4-6deb1d6658a0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:52.413940 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0a3de41c-f6dc-4d31-9ff4-6deb1d6658a0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:52.413940 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0a3de41c-f6dc-4d31-9ff4-6deb1d6658a0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:52.714145 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:52.714743 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:52.718426 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0a3de41c-f6dc-4d31-9ff4-6deb1d6658a0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:52.731354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0a3de41c-f6dc-4d31-9ff4-6deb1d6658a0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:52.734750 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0a3de41c-f6dc-4d31-9ff4-6deb1d6658a0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:52.735948 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:52.736413 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:52.737199 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:52.737625 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:52.743161 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0a3de41c-f6dc-4d31-9ff4-6deb1d6658a0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.348469 Jun 30 04:16:52.754935 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 100/184] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:52 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:16:52.772272 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:52.772741 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:52.773190 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lazy-loading 'fault' on Instance uuid 013e6bcd-1dfa-41de-b517-1dd0054ee024 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:16:52.862386 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787ef24488804250a58038c7378623ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94100e07e4d34a679ae537cb87de4dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:52.865990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:52.870990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e626d4d0-20a7-494d-b05a-c4474cff547f tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 200 len: 1302 microversion: 2.1 time: 0.160943 Jun 30 04:16:52.871623 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 85/185] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:52 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 1302 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:53.153983 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e923dfda-629a-4431-a953-879db001820c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:53.154874 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e923dfda-629a-4431-a953-879db001820c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:53.162258 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e923dfda-629a-4431-a953-879db001820c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.162850 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e923dfda-629a-4431-a953-879db001820c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.163788 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e923dfda-629a-4431-a953-879db001820c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.164292 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e923dfda-629a-4431-a953-879db001820c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.321853 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-64864ae6-3102-4119-8511-3b0db7cc00df tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:53.321853 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-64864ae6-3102-4119-8511-3b0db7cc00df tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:53.328199 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-64864ae6-3102-4119-8511-3b0db7cc00df tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.328804 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-64864ae6-3102-4119-8511-3b0db7cc00df tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.329399 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-64864ae6-3102-4119-8511-3b0db7cc00df tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.329832 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-64864ae6-3102-4119-8511-3b0db7cc00df tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.610730 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e923dfda-629a-4431-a953-879db001820c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:53.618366 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e923dfda-629a-4431-a953-879db001820c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.468413 Jun 30 04:16:53.618928 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 101/186] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:53 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:53.626835 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8f10eb72-fc61-437e-aec4-533ae914f538 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:53.626835 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8f10eb72-fc61-437e-aec4-533ae914f538 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:53.630476 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f10eb72-fc61-437e-aec4-533ae914f538 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.630952 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f10eb72-fc61-437e-aec4-533ae914f538 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.631761 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f10eb72-fc61-437e-aec4-533ae914f538 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.632164 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f10eb72-fc61-437e-aec4-533ae914f538 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.759712 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-64864ae6-3102-4119-8511-3b0db7cc00df tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:53.767549 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-64864ae6-3102-4119-8511-3b0db7cc00df tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.452423 Jun 30 04:16:53.768493 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 86/187] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:53 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:53.773368 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-046f713f-8aa1-42d1-bf23-3f649d47659e req-818ef9b7-7174-466e-8464-675b7e7380d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a5fa82-8302-40a4-bdd8-f8ee19570259", "tag": "ff35c296-16d8-4967-9683-da4fed5ad994"}, {"name": "network-changed", "server_uuid": "d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13", "tag": "14681158-c69f-4840-927a-2a8907e26393"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:53.790745 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-046f713f-8aa1-42d1-bf23-3f649d47659e req-818ef9b7-7174-466e-8464-675b7e7380d3 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.791150 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-046f713f-8aa1-42d1-bf23-3f649d47659e req-818ef9b7-7174-466e-8464-675b7e7380d3 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.804678 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-046f713f-8aa1-42d1-bf23-3f649d47659e req-818ef9b7-7174-466e-8464-675b7e7380d3 service nova] Creating event network-changed:ff35c296-16d8-4967-9683-da4fed5ad994 for instance e6a5fa82-8302-40a4-bdd8-f8ee19570259 on hv-cinder-84684 Jun 30 04:16:53.805431 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-046f713f-8aa1-42d1-bf23-3f649d47659e req-818ef9b7-7174-466e-8464-675b7e7380d3 service nova] Creating event network-changed:14681158-c69f-4840-927a-2a8907e26393 for instance d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 on hv-cinder-84684 Jun 30 04:16:53.812475 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-046f713f-8aa1-42d1-bf23-3f649d47659e req-818ef9b7-7174-466e-8464-675b7e7380d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042292 Jun 30 04:16:53.813026 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 87/188] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:16:53.818659 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f05e9a55-eaec-4fbc-853d-7f90d426c58c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:53.819604 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f05e9a55-eaec-4fbc-853d-7f90d426c58c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:53.826669 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f05e9a55-eaec-4fbc-853d-7f90d426c58c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.827175 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f05e9a55-eaec-4fbc-853d-7f90d426c58c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.827971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f05e9a55-eaec-4fbc-853d-7f90d426c58c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.828404 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f05e9a55-eaec-4fbc-853d-7f90d426c58c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.935353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8f10eb72-fc61-437e-aec4-533ae914f538 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:53.944161 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8f10eb72-fc61-437e-aec4-533ae914f538 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.324054 Jun 30 04:16:53.944659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 102/189] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:53 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:53.949058 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-57df74a2-0050-41a8-a87e-f20cff785cb7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:53.949722 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-57df74a2-0050-41a8-a87e-f20cff785cb7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] [instance: 013e6bcd-1dfa-41de-b517-1dd0054ee024] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:53.956400 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-57df74a2-0050-41a8-a87e-f20cff785cb7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.956801 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-57df74a2-0050-41a8-a87e-f20cff785cb7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.957773 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-57df74a2-0050-41a8-a87e-f20cff785cb7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:53.958196 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-57df74a2-0050-41a8-a87e-f20cff785cb7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:53.973563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-57df74a2-0050-41a8-a87e-f20cff785cb7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] HTTP exception thrown: Instance 013e6bcd-1dfa-41de-b517-1dd0054ee024 could not be found. Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-57df74a2-0050-41a8-a87e-f20cff785cb7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Request method failure captured: Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 HTTP/1.1 Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSOBQzUx95A0zV2yVvq6hTgFogepjdvr_X1V4goNqC2OK-wq3e4G1z7n7wOLW2YKsGDAWnuufhT_YzR1fbyh46bmq0F-DHlhmznXyIr3uEeApGc8x7xZJTkXOvWxVAhuFf8vR-91MrU63G23wsz_9t_nORAQLqTYu26KExFKxNFDLlo Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 94100e07e4d34a679ae537cb87de4dba Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-VolumesActionsTest-91720519 Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:16:53.975249 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94100e07e4d34a679ae537cb87de4dba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_94100e07e4d34a679ae537cb87de4dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/94100e07e4d34a679ae537cb87de4dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/94100e07e4d34a679ae537cb87de4dba"}]}] Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-VolumesActionsTest-91720519 Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 94100e07e4d34a679ae537cb87de4dba Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-VolumesActionsTest-91720519 Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-VolumesActionsTest-91720519-project Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: 787ef24488804250a58038c7378623ae Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-VolumesActionsTest-91720519-project Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 013e6bcd-1dfa-41de-b517-1dd0054ee024 could not be found. Jun 30 04:16:53.976591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '013e6bcd-1dfa-41de-b517-1dd0054ee024'} Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013e6bcd-1dfa-41de-b517-1dd0054ee024 could not be found. Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:16:53.977497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013e6bcd-1dfa-41de-b517-1dd0054ee024 could not be found. Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013e6bcd-1dfa-41de-b517-1dd0054ee024 could not be found. Jun 30 04:16:53.979001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:16:53.980327 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-57df74a2-0050-41a8-a87e-f20cff785cb7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] Returning 404 to user: Instance 013e6bcd-1dfa-41de-b517-1dd0054ee024 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:16:53.980327 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-57df74a2-0050-41a8-a87e-f20cff785cb7 tempest-VolumesActionsTest-91720519 tempest-VolumesActionsTest-91720519-project] 10.222.0.13 "GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024" status: 404 len: 111 microversion: 2.1 time: 0.031079 Jun 30 04:16:53.980327 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 103/190] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:53 2022] GET /compute/v2.1/servers/013e6bcd-1dfa-41de-b517-1dd0054ee024 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:16:54.051856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f05e9a55-eaec-4fbc-853d-7f90d426c58c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:54.061302 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f05e9a55-eaec-4fbc-853d-7f90d426c58c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:54.063821 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f05e9a55-eaec-4fbc-853d-7f90d426c58c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:54.065602 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f05e9a55-eaec-4fbc-853d-7f90d426c58c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.251045 Jun 30 04:16:54.066563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 88/191] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:53 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:16:54.636229 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b36aec5a-41ed-40d4-883d-051c48389b1e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:54.636839 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b36aec5a-41ed-40d4-883d-051c48389b1e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:54.643777 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b36aec5a-41ed-40d4-883d-051c48389b1e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:54.644217 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b36aec5a-41ed-40d4-883d-051c48389b1e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:54.644975 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b36aec5a-41ed-40d4-883d-051c48389b1e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:54.645761 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b36aec5a-41ed-40d4-883d-051c48389b1e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:54.786648 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b049fd34-aa38-457e-a222-a486efbb56ee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:54.788122 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b049fd34-aa38-457e-a222-a486efbb56ee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:54.791014 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=4 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:54.796949 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b049fd34-aa38-457e-a222-a486efbb56ee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:54.797571 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b049fd34-aa38-457e-a222-a486efbb56ee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:54.798613 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b049fd34-aa38-457e-a222-a486efbb56ee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:54.799439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b049fd34-aa38-457e-a222-a486efbb56ee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:54.995721 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b36aec5a-41ed-40d4-883d-051c48389b1e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:55.003887 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b36aec5a-41ed-40d4-883d-051c48389b1e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.371993 Jun 30 04:16:55.004425 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 104/192] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:54 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:55.008947 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-505fd6d3-8752-42bf-a92b-4737d568a770 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:55.009552 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-505fd6d3-8752-42bf-a92b-4737d568a770 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:55.015703 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-505fd6d3-8752-42bf-a92b-4737d568a770 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:55.016146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-505fd6d3-8752-42bf-a92b-4737d568a770 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:55.016903 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-505fd6d3-8752-42bf-a92b-4737d568a770 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:55.017355 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-505fd6d3-8752-42bf-a92b-4737d568a770 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:55.025144 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b049fd34-aa38-457e-a222-a486efbb56ee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:55.033347 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b049fd34-aa38-457e-a222-a486efbb56ee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.252462 Jun 30 04:16:55.034291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 89/193] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:54 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:16:55.085266 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8cb981aa-c36a-4db4-af9d-59b70a91b52b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:55.086135 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8cb981aa-c36a-4db4-af9d-59b70a91b52b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:55.092447 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8cb981aa-c36a-4db4-af9d-59b70a91b52b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:55.093668 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8cb981aa-c36a-4db4-af9d-59b70a91b52b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:55.094628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8cb981aa-c36a-4db4-af9d-59b70a91b52b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:55.095293 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8cb981aa-c36a-4db4-af9d-59b70a91b52b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:55.190295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-505fd6d3-8752-42bf-a92b-4737d568a770 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:55.198688 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-505fd6d3-8752-42bf-a92b-4737d568a770 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.193213 Jun 30 04:16:55.199388 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 105/194] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:55 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:55.255028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8cb981aa-c36a-4db4-af9d-59b70a91b52b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:55.266143 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8cb981aa-c36a-4db4-af9d-59b70a91b52b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:55.267653 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8cb981aa-c36a-4db4-af9d-59b70a91b52b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:55.268803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8cb981aa-c36a-4db4-af9d-59b70a91b52b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.187678 Jun 30 04:16:55.269366 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 90/195] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:55 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:16:55.832656 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-5d8d2cf1-48ac-4ae5-8fc8-25e049146189 req-c14c1a3f-98a3-4fb8-be6c-16042a69c61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1faec7e8-1e39-47c4-aba5-2e67eaf2936c", "tag": "fca67734-6bd5-404d-9a44-a44b374bc3a8"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:55.836432 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=4 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:55.838795 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=16 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:55.844087 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-5d8d2cf1-48ac-4ae5-8fc8-25e049146189 req-c14c1a3f-98a3-4fb8-be6c-16042a69c61e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:55.844532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-5d8d2cf1-48ac-4ae5-8fc8-25e049146189 req-c14c1a3f-98a3-4fb8-be6c-16042a69c61e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:55.855444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-5d8d2cf1-48ac-4ae5-8fc8-25e049146189 req-c14c1a3f-98a3-4fb8-be6c-16042a69c61e service nova] Creating event network-changed:fca67734-6bd5-404d-9a44-a44b374bc3a8 for instance 1faec7e8-1e39-47c4-aba5-2e67eaf2936c on hv-cinder-84684 Jun 30 04:16:55.860338 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-5d8d2cf1-48ac-4ae5-8fc8-25e049146189 req-c14c1a3f-98a3-4fb8-be6c-16042a69c61e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031363 Jun 30 04:16:55.860924 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 106/196] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:16:56.020931 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-78a652bf-5ddc-484e-bc4e-c936bee6fe4b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:56.021819 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-78a652bf-5ddc-484e-bc4e-c936bee6fe4b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:56.023673 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=14 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:56.030000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-78a652bf-5ddc-484e-bc4e-c936bee6fe4b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:56.030628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-78a652bf-5ddc-484e-bc4e-c936bee6fe4b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:56.031764 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-78a652bf-5ddc-484e-bc4e-c936bee6fe4b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:56.032336 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-78a652bf-5ddc-484e-bc4e-c936bee6fe4b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:56.050731 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5238a705-8aee-44f7-9fe2-44cf236cc4c9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:56.051361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5238a705-8aee-44f7-9fe2-44cf236cc4c9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:56.057679 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5238a705-8aee-44f7-9fe2-44cf236cc4c9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:56.058116 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5238a705-8aee-44f7-9fe2-44cf236cc4c9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:56.058857 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5238a705-8aee-44f7-9fe2-44cf236cc4c9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:56.059343 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5238a705-8aee-44f7-9fe2-44cf236cc4c9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:56.217885 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-78a652bf-5ddc-484e-bc4e-c936bee6fe4b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:56.225991 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-78a652bf-5ddc-484e-bc4e-c936bee6fe4b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.209515 Jun 30 04:16:56.226570 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 91/197] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:56 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:56.230991 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-faa0d2e2-aa6a-4a03-aa10-48be28d7ccda tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:56.231612 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-faa0d2e2-aa6a-4a03-aa10-48be28d7ccda tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:56.239014 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-faa0d2e2-aa6a-4a03-aa10-48be28d7ccda tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:56.239742 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-faa0d2e2-aa6a-4a03-aa10-48be28d7ccda tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:56.240230 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5238a705-8aee-44f7-9fe2-44cf236cc4c9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:56.240765 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-faa0d2e2-aa6a-4a03-aa10-48be28d7ccda tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:56.241206 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-faa0d2e2-aa6a-4a03-aa10-48be28d7ccda tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:56.248115 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5238a705-8aee-44f7-9fe2-44cf236cc4c9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.201981 Jun 30 04:16:56.248724 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 107/198] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:56 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:56.287723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fbbff0ec-206e-45a6-8c10-caf979f0a02f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:56.288330 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fbbff0ec-206e-45a6-8c10-caf979f0a02f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:56.295124 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fbbff0ec-206e-45a6-8c10-caf979f0a02f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:56.295582 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fbbff0ec-206e-45a6-8c10-caf979f0a02f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:56.296622 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fbbff0ec-206e-45a6-8c10-caf979f0a02f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:56.297019 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fbbff0ec-206e-45a6-8c10-caf979f0a02f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:56.424185 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-faa0d2e2-aa6a-4a03-aa10-48be28d7ccda tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:56.433393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-faa0d2e2-aa6a-4a03-aa10-48be28d7ccda tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.205770 Jun 30 04:16:56.434104 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 92/199] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:56 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:56.461584 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fbbff0ec-206e-45a6-8c10-caf979f0a02f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:56.470333 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fbbff0ec-206e-45a6-8c10-caf979f0a02f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:56.471884 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fbbff0ec-206e-45a6-8c10-caf979f0a02f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:56.473037 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fbbff0ec-206e-45a6-8c10-caf979f0a02f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.189666 Jun 30 04:16:56.473599 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 108/200] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:56 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:16:57.243201 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-314b080b-29e7-4bde-a50f-6cd1fa629b1b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:57.243776 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-314b080b-29e7-4bde-a50f-6cd1fa629b1b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:57.250901 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-314b080b-29e7-4bde-a50f-6cd1fa629b1b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:57.251337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-314b080b-29e7-4bde-a50f-6cd1fa629b1b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:57.252431 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-314b080b-29e7-4bde-a50f-6cd1fa629b1b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:57.252855 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-314b080b-29e7-4bde-a50f-6cd1fa629b1b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:57.265416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-be66e2aa-aee9-4b92-887a-49563f9f1ec3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:57.266361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-be66e2aa-aee9-4b92-887a-49563f9f1ec3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:57.274983 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-be66e2aa-aee9-4b92-887a-49563f9f1ec3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:57.275569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-be66e2aa-aee9-4b92-887a-49563f9f1ec3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:57.276627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-be66e2aa-aee9-4b92-887a-49563f9f1ec3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:57.277171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-be66e2aa-aee9-4b92-887a-49563f9f1ec3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:57.465408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-314b080b-29e7-4bde-a50f-6cd1fa629b1b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:57.474757 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-314b080b-29e7-4bde-a50f-6cd1fa629b1b tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.235451 Jun 30 04:16:57.475815 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 93/201] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:57 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:57.480732 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fcf4be9d-6dbf-4f35-ab83-7a239dd8b304 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:57.481099 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-be66e2aa-aee9-4b92-887a-49563f9f1ec3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:57.481327 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fcf4be9d-6dbf-4f35-ab83-7a239dd8b304 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:57.489060 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcf4be9d-6dbf-4f35-ab83-7a239dd8b304 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:57.489501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcf4be9d-6dbf-4f35-ab83-7a239dd8b304 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:57.489744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-be66e2aa-aee9-4b92-887a-49563f9f1ec3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.227991 Jun 30 04:16:57.490262 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcf4be9d-6dbf-4f35-ab83-7a239dd8b304 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:57.498863 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 109/202] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:57 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:57.499056 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcf4be9d-6dbf-4f35-ab83-7a239dd8b304 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:57.499173 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6a03574a-2791-46e0-a58c-97559ee25670 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:57.499173 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6a03574a-2791-46e0-a58c-97559ee25670 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:57.502334 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6a03574a-2791-46e0-a58c-97559ee25670 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:57.502838 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6a03574a-2791-46e0-a58c-97559ee25670 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:57.503683 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6a03574a-2791-46e0-a58c-97559ee25670 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:57.504184 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6a03574a-2791-46e0-a58c-97559ee25670 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:57.690323 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fcf4be9d-6dbf-4f35-ab83-7a239dd8b304 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:57.697016 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6a03574a-2791-46e0-a58c-97559ee25670 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:57.698134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fcf4be9d-6dbf-4f35-ab83-7a239dd8b304 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.221205 Jun 30 04:16:57.698691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 94/203] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:57 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:57.705306 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6a03574a-2791-46e0-a58c-97559ee25670 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:57.706794 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6a03574a-2791-46e0-a58c-97559ee25670 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:57.707970 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6a03574a-2791-46e0-a58c-97559ee25670 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.215967 Jun 30 04:16:57.708719 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 110/204] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:57 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:16:58.491954 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2dd0da49-a39c-4814-86b1-ee00028a3197 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:58.492567 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2dd0da49-a39c-4814-86b1-ee00028a3197 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:58.498679 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2dd0da49-a39c-4814-86b1-ee00028a3197 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:58.499164 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2dd0da49-a39c-4814-86b1-ee00028a3197 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:58.499912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2dd0da49-a39c-4814-86b1-ee00028a3197 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:58.500341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2dd0da49-a39c-4814-86b1-ee00028a3197 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:58.506429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-2ed7e065-04ed-4452-bb72-7c1e637c5727 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:58.507111 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-2ed7e065-04ed-4452-bb72-7c1e637c5727 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:58.510546 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:16:58.514727 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2ed7e065-04ed-4452-bb72-7c1e637c5727 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:58.515204 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2ed7e065-04ed-4452-bb72-7c1e637c5727 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:58.516002 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2ed7e065-04ed-4452-bb72-7c1e637c5727 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:58.516438 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2ed7e065-04ed-4452-bb72-7c1e637c5727 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:58.702710 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2dd0da49-a39c-4814-86b1-ee00028a3197 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:58.710510 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-2ed7e065-04ed-4452-bb72-7c1e637c5727 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:58.712193 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2dd0da49-a39c-4814-86b1-ee00028a3197 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.223566 Jun 30 04:16:58.712818 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 95/205] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:58 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:58.717516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-21aacb39-90b0-4130-add8-2023c10a4b42 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:58.718324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-21aacb39-90b0-4130-add8-2023c10a4b42 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:58.721337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-2ed7e065-04ed-4452-bb72-7c1e637c5727 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.219319 Jun 30 04:16:58.725742 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21aacb39-90b0-4130-add8-2023c10a4b42 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:58.726180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21aacb39-90b0-4130-add8-2023c10a4b42 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:58.727286 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21aacb39-90b0-4130-add8-2023c10a4b42 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:58.727724 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21aacb39-90b0-4130-add8-2023c10a4b42 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:58.732171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 111/206] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:58 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:16:58.737611 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ada185df-9c63-4c1e-8e97-e06e82d91fa2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:58.738485 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ada185df-9c63-4c1e-8e97-e06e82d91fa2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:58.745657 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ada185df-9c63-4c1e-8e97-e06e82d91fa2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:58.746218 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ada185df-9c63-4c1e-8e97-e06e82d91fa2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:58.747069 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ada185df-9c63-4c1e-8e97-e06e82d91fa2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:58.747522 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ada185df-9c63-4c1e-8e97-e06e82d91fa2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:58.941013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-21aacb39-90b0-4130-add8-2023c10a4b42 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:58.949292 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ada185df-9c63-4c1e-8e97-e06e82d91fa2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:58.950504 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-21aacb39-90b0-4130-add8-2023c10a4b42 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.236512 Jun 30 04:16:58.951114 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 96/207] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:58 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:16:58.960501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-9c77314d-a26b-4be6-85e0-7226eec20335 req-b14d6910-8237-4f48-aaf0-d360bdfbb907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a789ea-78f4-481d-bd9b-45bce25676ad", "name": "network-vif-plugged", "status": "completed", "tag": "f7491189-7e96-4247-aee7-3f42f81272cd"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:16:58.960714 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ada185df-9c63-4c1e-8e97-e06e82d91fa2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:58.962598 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ada185df-9c63-4c1e-8e97-e06e82d91fa2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:16:58.964310 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ada185df-9c63-4c1e-8e97-e06e82d91fa2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.230693 Jun 30 04:16:58.976954 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 112/208] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:16:58 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:16:58.982690 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9c77314d-a26b-4be6-85e0-7226eec20335 req-b14d6910-8237-4f48-aaf0-d360bdfbb907 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:58.983116 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9c77314d-a26b-4be6-85e0-7226eec20335 req-b14d6910-8237-4f48-aaf0-d360bdfbb907 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:58.996177 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-9c77314d-a26b-4be6-85e0-7226eec20335 req-b14d6910-8237-4f48-aaf0-d360bdfbb907 service nova] Creating event network-vif-plugged:f7491189-7e96-4247-aee7-3f42f81272cd for instance b9a789ea-78f4-481d-bd9b-45bce25676ad on hv-cinder-84684 Jun 30 04:16:59.003684 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-9c77314d-a26b-4be6-85e0-7226eec20335 req-b14d6910-8237-4f48-aaf0-d360bdfbb907 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046757 Jun 30 04:16:59.005258 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 97/209] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:16:59.732979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b3b7847f-877a-4723-82d5-28e6dd24cec4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:59.735627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b3b7847f-877a-4723-82d5-28e6dd24cec4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:59.741005 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a4fb94f3-c4ad-42a8-8694-1e16d60f68bb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:16:59.741941 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a4fb94f3-c4ad-42a8-8694-1e16d60f68bb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:16:59.746932 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b3b7847f-877a-4723-82d5-28e6dd24cec4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:59.747673 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b3b7847f-877a-4723-82d5-28e6dd24cec4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:59.748714 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b3b7847f-877a-4723-82d5-28e6dd24cec4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:59.761353 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a4fb94f3-c4ad-42a8-8694-1e16d60f68bb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:59.772984 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b3b7847f-877a-4723-82d5-28e6dd24cec4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:59.775737 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a4fb94f3-c4ad-42a8-8694-1e16d60f68bb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:16:59.776660 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a4fb94f3-c4ad-42a8-8694-1e16d60f68bb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:16:59.777295 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a4fb94f3-c4ad-42a8-8694-1e16d60f68bb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:00.062343 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b3b7847f-877a-4723-82d5-28e6dd24cec4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:00.076583 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b3b7847f-877a-4723-82d5-28e6dd24cec4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.350014 Jun 30 04:17:00.078163 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 113/210] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:59 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:00.086309 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8468bc9f-c0f6-454d-9a52-496d5a622f60 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:00.087284 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8468bc9f-c0f6-454d-9a52-496d5a622f60 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:00.097690 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8468bc9f-c0f6-454d-9a52-496d5a622f60 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:00.098853 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8468bc9f-c0f6-454d-9a52-496d5a622f60 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:00.100033 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8468bc9f-c0f6-454d-9a52-496d5a622f60 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:00.100768 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8468bc9f-c0f6-454d-9a52-496d5a622f60 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:00.103644 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a4fb94f3-c4ad-42a8-8694-1e16d60f68bb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:00.116982 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a4fb94f3-c4ad-42a8-8694-1e16d60f68bb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.382149 Jun 30 04:17:00.117694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 98/211] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:16:59 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:00.132158 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-df742672-6504-4caa-b872-5be73055b511 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:00.132760 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-df742672-6504-4caa-b872-5be73055b511 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:00.141661 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df742672-6504-4caa-b872-5be73055b511 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:00.142543 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df742672-6504-4caa-b872-5be73055b511 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:00.143143 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df742672-6504-4caa-b872-5be73055b511 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:00.143734 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df742672-6504-4caa-b872-5be73055b511 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:00.341543 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8468bc9f-c0f6-454d-9a52-496d5a622f60 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:00.349529 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8468bc9f-c0f6-454d-9a52-496d5a622f60 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.269921 Jun 30 04:17:00.354413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 114/212] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:00 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:00.362644 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-df742672-6504-4caa-b872-5be73055b511 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:00.371701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-df742672-6504-4caa-b872-5be73055b511 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:00.373544 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-df742672-6504-4caa-b872-5be73055b511 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:00.374946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-df742672-6504-4caa-b872-5be73055b511 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.246679 Jun 30 04:17:00.385941 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 99/213] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:00 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:01.097451 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a2af5cf8-f309-4385-b790-030644eebcdc tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:01.099584 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a2af5cf8-f309-4385-b790-030644eebcdc tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:01.106354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a2af5cf8-f309-4385-b790-030644eebcdc tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:01.107171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a2af5cf8-f309-4385-b790-030644eebcdc tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:01.108189 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a2af5cf8-f309-4385-b790-030644eebcdc tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:01.108763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a2af5cf8-f309-4385-b790-030644eebcdc tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:01.134745 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7cc0086c-8b5b-47fd-b569-66441d7ee5b3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:01.136065 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7cc0086c-8b5b-47fd-b569-66441d7ee5b3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:01.139974 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:01.150793 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7cc0086c-8b5b-47fd-b569-66441d7ee5b3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:01.155320 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7cc0086c-8b5b-47fd-b569-66441d7ee5b3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:01.156411 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7cc0086c-8b5b-47fd-b569-66441d7ee5b3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:01.157810 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7cc0086c-8b5b-47fd-b569-66441d7ee5b3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:01.395768 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a2af5cf8-f309-4385-b790-030644eebcdc tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:01.398672 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7cc0086c-8b5b-47fd-b569-66441d7ee5b3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:01.406664 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7cc0086c-8b5b-47fd-b569-66441d7ee5b3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.276374 Jun 30 04:17:01.407235 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a2af5cf8-f309-4385-b790-030644eebcdc tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.314023 Jun 30 04:17:01.408977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 100/214] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:01 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:01.411333 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 115/215] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:01 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:01.413927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d46ecf92-3aa6-4a1a-b055-bad9f30c3342 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:01.414832 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d46ecf92-3aa6-4a1a-b055-bad9f30c3342 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:01.416354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-946b2e84-c9d0-40b6-9c34-26d9b7e40644 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:01.416961 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-946b2e84-c9d0-40b6-9c34-26d9b7e40644 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:01.421888 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d46ecf92-3aa6-4a1a-b055-bad9f30c3342 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:01.422633 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d46ecf92-3aa6-4a1a-b055-bad9f30c3342 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:01.423730 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d46ecf92-3aa6-4a1a-b055-bad9f30c3342 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:01.424362 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d46ecf92-3aa6-4a1a-b055-bad9f30c3342 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:01.437492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-946b2e84-c9d0-40b6-9c34-26d9b7e40644 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:01.437948 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-946b2e84-c9d0-40b6-9c34-26d9b7e40644 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:01.442507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-946b2e84-c9d0-40b6-9c34-26d9b7e40644 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:01.442986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-946b2e84-c9d0-40b6-9c34-26d9b7e40644 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:01.638528 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d46ecf92-3aa6-4a1a-b055-bad9f30c3342 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:01.650149 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d46ecf92-3aa6-4a1a-b055-bad9f30c3342 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.239877 Jun 30 04:17:01.651758 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 101/216] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:01 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:01.677739 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-946b2e84-c9d0-40b6-9c34-26d9b7e40644 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:01.691579 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-946b2e84-c9d0-40b6-9c34-26d9b7e40644 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:01.693620 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-946b2e84-c9d0-40b6-9c34-26d9b7e40644 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:01.694821 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-946b2e84-c9d0-40b6-9c34-26d9b7e40644 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.282525 Jun 30 04:17:01.695429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 116/217] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:01 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:02.424962 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f4078204-2cc1-44bc-9b65-386f7cdf2579 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:02.425601 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8c4b4557-4ce9-43c3-9a40-c3180767cd05 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:02.426085 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8c4b4557-4ce9-43c3-9a40-c3180767cd05 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:02.429485 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f4078204-2cc1-44bc-9b65-386f7cdf2579 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:02.433260 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8c4b4557-4ce9-43c3-9a40-c3180767cd05 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:02.433972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8c4b4557-4ce9-43c3-9a40-c3180767cd05 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:02.435128 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8c4b4557-4ce9-43c3-9a40-c3180767cd05 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:02.435654 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8c4b4557-4ce9-43c3-9a40-c3180767cd05 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:02.438197 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4078204-2cc1-44bc-9b65-386f7cdf2579 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:02.438660 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4078204-2cc1-44bc-9b65-386f7cdf2579 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:02.439534 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4078204-2cc1-44bc-9b65-386f7cdf2579 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:02.439947 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4078204-2cc1-44bc-9b65-386f7cdf2579 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:02.648516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f4078204-2cc1-44bc-9b65-386f7cdf2579 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:02.661876 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f4078204-2cc1-44bc-9b65-386f7cdf2579 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.240932 Jun 30 04:17:02.662472 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 102/218] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:02 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:02.669657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c109b856-19b0-45eb-97e6-1e5baf637555 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:02.670582 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c109b856-19b0-45eb-97e6-1e5baf637555 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:02.679360 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c109b856-19b0-45eb-97e6-1e5baf637555 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:02.680123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c109b856-19b0-45eb-97e6-1e5baf637555 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:02.681509 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c109b856-19b0-45eb-97e6-1e5baf637555 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:02.681739 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8c4b4557-4ce9-43c3-9a40-c3180767cd05 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:02.682576 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c109b856-19b0-45eb-97e6-1e5baf637555 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:02.686155 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=100 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:02.691271 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8c4b4557-4ce9-43c3-9a40-c3180767cd05 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.270300 Jun 30 04:17:02.694763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 117/219] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:02 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:02.714811 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6694f411-b61f-489d-8374-d7e0fa957b54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:02.715088 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6694f411-b61f-489d-8374-d7e0fa957b54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:02.722023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6694f411-b61f-489d-8374-d7e0fa957b54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:02.722466 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6694f411-b61f-489d-8374-d7e0fa957b54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:02.723263 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6694f411-b61f-489d-8374-d7e0fa957b54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:02.723849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6694f411-b61f-489d-8374-d7e0fa957b54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:03.046568 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c109b856-19b0-45eb-97e6-1e5baf637555 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:03.050023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6694f411-b61f-489d-8374-d7e0fa957b54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:03.050757 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:03.057154 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c109b856-19b0-45eb-97e6-1e5baf637555 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.392257 Jun 30 04:17:03.058146 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 103/220] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:02 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:03.058548 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6694f411-b61f-489d-8374-d7e0fa957b54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:03.060098 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6694f411-b61f-489d-8374-d7e0fa957b54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:03.062191 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6694f411-b61f-489d-8374-d7e0fa957b54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.351276 Jun 30 04:17:03.074181 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 118/221] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:02 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:03.683186 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f79f844c-9dd6-4213-afa5-7c374e2c64e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:03.685072 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f79f844c-9dd6-4213-afa5-7c374e2c64e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:03.694806 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f79f844c-9dd6-4213-afa5-7c374e2c64e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:03.695499 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f79f844c-9dd6-4213-afa5-7c374e2c64e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:03.696765 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f79f844c-9dd6-4213-afa5-7c374e2c64e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:03.697469 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f79f844c-9dd6-4213-afa5-7c374e2c64e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:03.711145 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a86acdae-b849-41dd-905d-0b35d5430856 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:03.712016 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a86acdae-b849-41dd-905d-0b35d5430856 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:03.725776 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a86acdae-b849-41dd-905d-0b35d5430856 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:03.726390 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a86acdae-b849-41dd-905d-0b35d5430856 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:03.727715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a86acdae-b849-41dd-905d-0b35d5430856 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:03.728300 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a86acdae-b849-41dd-905d-0b35d5430856 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:03.928488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f79f844c-9dd6-4213-afa5-7c374e2c64e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:03.928822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a86acdae-b849-41dd-905d-0b35d5430856 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:03.952738 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f79f844c-9dd6-4213-afa5-7c374e2c64e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.276543 Jun 30 04:17:03.953340 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 104/222] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:03 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:17:03.953800 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a86acdae-b849-41dd-905d-0b35d5430856 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.242995 Jun 30 04:17:03.963184 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 119/223] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:03 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:17:04.076127 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4d15de6a-a441-4c0b-a1f0-d65565c20a6f tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:04.076127 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4d15de6a-a441-4c0b-a1f0-d65565c20a6f tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:04.084223 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4d15de6a-a441-4c0b-a1f0-d65565c20a6f tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:04.084967 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4d15de6a-a441-4c0b-a1f0-d65565c20a6f tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:04.085939 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4d15de6a-a441-4c0b-a1f0-d65565c20a6f tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:04.086542 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4d15de6a-a441-4c0b-a1f0-d65565c20a6f tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:04.090437 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e0977adb-70be-4a3d-983d-f24c7532b578 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:04.094151 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e0977adb-70be-4a3d-983d-f24c7532b578 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:04.109063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e0977adb-70be-4a3d-983d-f24c7532b578 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:04.109858 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e0977adb-70be-4a3d-983d-f24c7532b578 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:04.111262 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e0977adb-70be-4a3d-983d-f24c7532b578 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:04.112035 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e0977adb-70be-4a3d-983d-f24c7532b578 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:04.290009 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4d15de6a-a441-4c0b-a1f0-d65565c20a6f tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:04.301295 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4d15de6a-a441-4c0b-a1f0-d65565c20a6f tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.230500 Jun 30 04:17:04.309050 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 105/224] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:04 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:04.316471 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e0977adb-70be-4a3d-983d-f24c7532b578 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:04.325499 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e0977adb-70be-4a3d-983d-f24c7532b578 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:04.327277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e0977adb-70be-4a3d-983d-f24c7532b578 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:04.328519 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e0977adb-70be-4a3d-983d-f24c7532b578 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.250609 Jun 30 04:17:04.329553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 120/225] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:04 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:04.978043 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-69e22581-f957-4976-a6ed-813918756333 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:04.978515 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1c7783e7-e424-49e6-bdfa-cc7e31abd4b6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:04.978910 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-69e22581-f957-4976-a6ed-813918756333 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:04.979008 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1c7783e7-e424-49e6-bdfa-cc7e31abd4b6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:04.987519 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69e22581-f957-4976-a6ed-813918756333 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:04.987699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69e22581-f957-4976-a6ed-813918756333 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:04.988724 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69e22581-f957-4976-a6ed-813918756333 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:04.989299 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69e22581-f957-4976-a6ed-813918756333 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:04.989572 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1c7783e7-e424-49e6-bdfa-cc7e31abd4b6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:04.989970 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1c7783e7-e424-49e6-bdfa-cc7e31abd4b6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:04.990739 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1c7783e7-e424-49e6-bdfa-cc7e31abd4b6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:04.991184 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1c7783e7-e424-49e6-bdfa-cc7e31abd4b6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:05.219280 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1c7783e7-e424-49e6-bdfa-cc7e31abd4b6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:05.224008 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-69e22581-f957-4976-a6ed-813918756333 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:05.234064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-69e22581-f957-4976-a6ed-813918756333 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.267017 Jun 30 04:17:05.234447 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1c7783e7-e424-49e6-bdfa-cc7e31abd4b6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.265482 Jun 30 04:17:05.235257 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 121/226] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:04 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:05.238172 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 106/227] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:04 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:05.318240 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-301cf3fc-7d95-4cb5-9bef-1da4932ee90a tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:05.319172 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-301cf3fc-7d95-4cb5-9bef-1da4932ee90a tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:05.327676 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-301cf3fc-7d95-4cb5-9bef-1da4932ee90a tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:05.328122 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-301cf3fc-7d95-4cb5-9bef-1da4932ee90a tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:05.328864 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-301cf3fc-7d95-4cb5-9bef-1da4932ee90a tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:05.329307 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-301cf3fc-7d95-4cb5-9bef-1da4932ee90a tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:05.348707 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-09664467-5f70-48d2-9b9d-7c29c43a433c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:05.349303 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-09664467-5f70-48d2-9b9d-7c29c43a433c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:05.357846 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09664467-5f70-48d2-9b9d-7c29c43a433c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:05.358288 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09664467-5f70-48d2-9b9d-7c29c43a433c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:05.359262 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09664467-5f70-48d2-9b9d-7c29c43a433c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:05.359816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09664467-5f70-48d2-9b9d-7c29c43a433c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:05.562631 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-301cf3fc-7d95-4cb5-9bef-1da4932ee90a tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:05.570681 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-301cf3fc-7d95-4cb5-9bef-1da4932ee90a tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.256372 Jun 30 04:17:05.578821 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-09664467-5f70-48d2-9b9d-7c29c43a433c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:05.579950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 122/228] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:05 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:05.588106 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-09664467-5f70-48d2-9b9d-7c29c43a433c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:05.591313 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-09664467-5f70-48d2-9b9d-7c29c43a433c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:05.592747 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-09664467-5f70-48d2-9b9d-7c29c43a433c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.250789 Jun 30 04:17:05.593542 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 107/229] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:05 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:17:06.260787 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9b7b90f1-787d-4a66-b20a-de053465b519 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:06.261407 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9b7b90f1-787d-4a66-b20a-de053465b519 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:06.271670 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-28972463-a3e3-49dc-b0cb-d354a8a9e119 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:06.272745 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-28972463-a3e3-49dc-b0cb-d354a8a9e119 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:06.276475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9b7b90f1-787d-4a66-b20a-de053465b519 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:06.277412 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9b7b90f1-787d-4a66-b20a-de053465b519 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:06.278804 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9b7b90f1-787d-4a66-b20a-de053465b519 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:06.279478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9b7b90f1-787d-4a66-b20a-de053465b519 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:06.280345 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28972463-a3e3-49dc-b0cb-d354a8a9e119 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:06.281094 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28972463-a3e3-49dc-b0cb-d354a8a9e119 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:06.281866 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28972463-a3e3-49dc-b0cb-d354a8a9e119 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:06.282439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28972463-a3e3-49dc-b0cb-d354a8a9e119 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:06.551156 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9b7b90f1-787d-4a66-b20a-de053465b519 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:06.552097 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-28972463-a3e3-49dc-b0cb-d354a8a9e119 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:06.575910 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-28972463-a3e3-49dc-b0cb-d354a8a9e119 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.316149 Jun 30 04:17:06.576178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9b7b90f1-787d-4a66-b20a-de053465b519 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.317054 Jun 30 04:17:06.595338 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 123/230] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:06 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:06.606581 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 108/231] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:06 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:06.614130 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6e953ec6-d70a-418d-91b6-69449dbd61e0 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:06.614949 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ca42c1ed-1ef5-4037-ae64-81a352062a54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:06.615600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ca42c1ed-1ef5-4037-ae64-81a352062a54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:06.617808 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6e953ec6-d70a-418d-91b6-69449dbd61e0 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:06.625748 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6e953ec6-d70a-418d-91b6-69449dbd61e0 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:06.626198 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6e953ec6-d70a-418d-91b6-69449dbd61e0 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:06.627055 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6e953ec6-d70a-418d-91b6-69449dbd61e0 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:06.627644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca42c1ed-1ef5-4037-ae64-81a352062a54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:06.627748 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6e953ec6-d70a-418d-91b6-69449dbd61e0 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:06.627826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca42c1ed-1ef5-4037-ae64-81a352062a54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:06.628658 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca42c1ed-1ef5-4037-ae64-81a352062a54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:06.629087 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca42c1ed-1ef5-4037-ae64-81a352062a54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:06.830452 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6e953ec6-d70a-418d-91b6-69449dbd61e0 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:06.854235 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6e953ec6-d70a-418d-91b6-69449dbd61e0 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.248505 Jun 30 04:17:06.865711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 109/232] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:06 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:06.880811 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ca42c1ed-1ef5-4037-ae64-81a352062a54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:06.894603 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ca42c1ed-1ef5-4037-ae64-81a352062a54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:06.900220 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ca42c1ed-1ef5-4037-ae64-81a352062a54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:06.901769 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ca42c1ed-1ef5-4037-ae64-81a352062a54 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.294018 Jun 30 04:17:06.902560 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 124/233] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:06 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:07.067265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-aa4ecabf-83c1-44bd-9ca8-0c867c34f97f req-b276ece1-7746-4158-a02a-7ac291c6bd7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a5fa82-8302-40a4-bdd8-f8ee19570259", "name": "network-vif-plugged", "status": "completed", "tag": "ff35c296-16d8-4967-9683-da4fed5ad994"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:07.085316 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-aa4ecabf-83c1-44bd-9ca8-0c867c34f97f req-b276ece1-7746-4158-a02a-7ac291c6bd7a service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:07.086692 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-aa4ecabf-83c1-44bd-9ca8-0c867c34f97f req-b276ece1-7746-4158-a02a-7ac291c6bd7a service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:07.113230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-aa4ecabf-83c1-44bd-9ca8-0c867c34f97f req-b276ece1-7746-4158-a02a-7ac291c6bd7a service nova] Creating event network-vif-plugged:ff35c296-16d8-4967-9683-da4fed5ad994 for instance e6a5fa82-8302-40a4-bdd8-f8ee19570259 on hv-cinder-84684 Jun 30 04:17:07.132736 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-aa4ecabf-83c1-44bd-9ca8-0c867c34f97f req-b276ece1-7746-4158-a02a-7ac291c6bd7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069265 Jun 30 04:17:07.133829 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 110/234] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:17:07.603417 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a6706c59-fcbf-4687-b146-25c5fdcdd728 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:07.608674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a6706c59-fcbf-4687-b146-25c5fdcdd728 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:07.615577 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-849a9ed0-e989-4602-81b1-a95cf93da813 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:07.617724 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-849a9ed0-e989-4602-81b1-a95cf93da813 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:07.626950 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-849a9ed0-e989-4602-81b1-a95cf93da813 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:07.627900 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-849a9ed0-e989-4602-81b1-a95cf93da813 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:07.628700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-849a9ed0-e989-4602-81b1-a95cf93da813 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:07.629282 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-849a9ed0-e989-4602-81b1-a95cf93da813 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:07.645355 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6706c59-fcbf-4687-b146-25c5fdcdd728 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:07.656757 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6706c59-fcbf-4687-b146-25c5fdcdd728 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:07.659364 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6706c59-fcbf-4687-b146-25c5fdcdd728 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:07.664403 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6706c59-fcbf-4687-b146-25c5fdcdd728 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:08.118208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-849a9ed0-e989-4602-81b1-a95cf93da813 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:08.128681 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-849a9ed0-e989-4602-81b1-a95cf93da813 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.520434 Jun 30 04:17:08.129757 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 111/235] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:07 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:08.138139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bbf14d51-73d8-4358-818e-76eabcb0d9d4 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:08.139449 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bbf14d51-73d8-4358-818e-76eabcb0d9d4 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:08.157171 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bbf14d51-73d8-4358-818e-76eabcb0d9d4 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:08.158565 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bbf14d51-73d8-4358-818e-76eabcb0d9d4 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:08.159527 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a6706c59-fcbf-4687-b146-25c5fdcdd728 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:08.159894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bbf14d51-73d8-4358-818e-76eabcb0d9d4 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:08.160487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bbf14d51-73d8-4358-818e-76eabcb0d9d4 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:08.170085 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a6706c59-fcbf-4687-b146-25c5fdcdd728 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.577791 Jun 30 04:17:08.180493 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 125/236] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:07 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:08.192210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-35b9f1cb-8f6e-462f-98fd-96c22c094678 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:08.193481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-35b9f1cb-8f6e-462f-98fd-96c22c094678 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:08.206530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-35b9f1cb-8f6e-462f-98fd-96c22c094678 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:08.206981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-35b9f1cb-8f6e-462f-98fd-96c22c094678 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:08.209111 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-35b9f1cb-8f6e-462f-98fd-96c22c094678 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:08.210419 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-35b9f1cb-8f6e-462f-98fd-96c22c094678 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:08.540273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bbf14d51-73d8-4358-818e-76eabcb0d9d4 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:08.547912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bbf14d51-73d8-4358-818e-76eabcb0d9d4 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.414265 Jun 30 04:17:08.548570 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 112/237] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:08 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:08.615569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-35b9f1cb-8f6e-462f-98fd-96c22c094678 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:08.632033 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-35b9f1cb-8f6e-462f-98fd-96c22c094678 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:08.635673 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-35b9f1cb-8f6e-462f-98fd-96c22c094678 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:08.637499 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-35b9f1cb-8f6e-462f-98fd-96c22c094678 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1745 microversion: 2.20 time: 0.455687 Jun 30 04:17:08.639718 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 126/238] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:08 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1745 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:09.145048 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-27d5d8a0-175c-4817-9795-0a33e374a4b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:09.146262 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-27d5d8a0-175c-4817-9795-0a33e374a4b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:09.152105 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-3689e43c-2993-42e5-ae49-381f086cb4dc req-b01a99ac-564b-4fcf-8460-3c73504023f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13", "name": "network-vif-plugged", "status": "completed", "tag": "14681158-c69f-4840-927a-2a8907e26393"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:09.156547 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-27d5d8a0-175c-4817-9795-0a33e374a4b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:09.156988 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-27d5d8a0-175c-4817-9795-0a33e374a4b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:09.171010 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-3689e43c-2993-42e5-ae49-381f086cb4dc req-b01a99ac-564b-4fcf-8460-3c73504023f8 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:09.172378 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-3689e43c-2993-42e5-ae49-381f086cb4dc req-b01a99ac-564b-4fcf-8460-3c73504023f8 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:09.173160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-27d5d8a0-175c-4817-9795-0a33e374a4b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:09.181868 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-27d5d8a0-175c-4817-9795-0a33e374a4b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:09.189837 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-3689e43c-2993-42e5-ae49-381f086cb4dc req-b01a99ac-564b-4fcf-8460-3c73504023f8 service nova] Creating event network-vif-plugged:14681158-c69f-4840-927a-2a8907e26393 for instance d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 on hv-cinder-84684 Jun 30 04:17:09.197633 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-3689e43c-2993-42e5-ae49-381f086cb4dc req-b01a99ac-564b-4fcf-8460-3c73504023f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049650 Jun 30 04:17:09.198908 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 127/239] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:17:09.204960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bf3906e9-72f9-4fc5-95a7-4b10f2d89c46 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:09.206878 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-bf3906e9-72f9-4fc5-95a7-4b10f2d89c46 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:09.214019 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bf3906e9-72f9-4fc5-95a7-4b10f2d89c46 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:09.214772 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bf3906e9-72f9-4fc5-95a7-4b10f2d89c46 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:09.216473 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bf3906e9-72f9-4fc5-95a7-4b10f2d89c46 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:09.217095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bf3906e9-72f9-4fc5-95a7-4b10f2d89c46 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:09.532412 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-27d5d8a0-175c-4817-9795-0a33e374a4b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:09.543115 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-bf3906e9-72f9-4fc5-95a7-4b10f2d89c46 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:09.559299 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bf3906e9-72f9-4fc5-95a7-4b10f2d89c46 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1318 microversion: 2.1 time: 0.358920 Jun 30 04:17:09.561675 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-27d5d8a0-175c-4817-9795-0a33e374a4b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.420796 Jun 30 04:17:09.563149 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 128/240] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:09 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:09.563529 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 113/241] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:09 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:09.569125 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ba257e8c-6ca9-4430-8971-49beba2a3bfb tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:09.569733 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ba257e8c-6ca9-4430-8971-49beba2a3bfb tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:09.576500 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ba257e8c-6ca9-4430-8971-49beba2a3bfb tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:09.577180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ba257e8c-6ca9-4430-8971-49beba2a3bfb tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:09.578126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ba257e8c-6ca9-4430-8971-49beba2a3bfb tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:09.578717 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ba257e8c-6ca9-4430-8971-49beba2a3bfb tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:09.658087 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8119a5da-3d9e-469d-bbfb-d51d5abc6337 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:09.659933 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8119a5da-3d9e-469d-bbfb-d51d5abc6337 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:09.673421 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8119a5da-3d9e-469d-bbfb-d51d5abc6337 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:09.674383 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8119a5da-3d9e-469d-bbfb-d51d5abc6337 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:09.675550 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8119a5da-3d9e-469d-bbfb-d51d5abc6337 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:09.676134 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8119a5da-3d9e-469d-bbfb-d51d5abc6337 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:09.964181 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ba257e8c-6ca9-4430-8971-49beba2a3bfb tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:09.975210 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ba257e8c-6ca9-4430-8971-49beba2a3bfb tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.410231 Jun 30 04:17:09.976171 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 114/242] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:09 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:10.088406 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8119a5da-3d9e-469d-bbfb-d51d5abc6337 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:10.104429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8119a5da-3d9e-469d-bbfb-d51d5abc6337 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:10.106284 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8119a5da-3d9e-469d-bbfb-d51d5abc6337 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:10.107742 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8119a5da-3d9e-469d-bbfb-d51d5abc6337 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1745 microversion: 2.20 time: 0.454084 Jun 30 04:17:10.108856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 129/243] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:09 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1745 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:17:10.580537 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-589a70fc-0e82-43f9-9c19-8f356be69890 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:10.582166 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-589a70fc-0e82-43f9-9c19-8f356be69890 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:10.582662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-92a68ad4-9680-4d25-8ba7-a8d3142d2ee5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:10.583433 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-92a68ad4-9680-4d25-8ba7-a8d3142d2ee5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:10.596154 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-589a70fc-0e82-43f9-9c19-8f356be69890 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:10.597090 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-589a70fc-0e82-43f9-9c19-8f356be69890 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:10.598457 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-589a70fc-0e82-43f9-9c19-8f356be69890 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:10.599323 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-589a70fc-0e82-43f9-9c19-8f356be69890 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:10.613904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-92a68ad4-9680-4d25-8ba7-a8d3142d2ee5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:10.614891 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-92a68ad4-9680-4d25-8ba7-a8d3142d2ee5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:10.616526 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-92a68ad4-9680-4d25-8ba7-a8d3142d2ee5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:10.617421 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-92a68ad4-9680-4d25-8ba7-a8d3142d2ee5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:10.904559 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-589a70fc-0e82-43f9-9c19-8f356be69890 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:10.916029 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-589a70fc-0e82-43f9-9c19-8f356be69890 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.340672 Jun 30 04:17:10.920371 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-92a68ad4-9680-4d25-8ba7-a8d3142d2ee5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:10.929825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-92a68ad4-9680-4d25-8ba7-a8d3142d2ee5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1506 microversion: 2.1 time: 0.353111 Jun 30 04:17:10.930404 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 130/244] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:10 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:10.930941 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 115/245] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:10 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:11.006115 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7a7d31e2-f83f-4d90-8b9f-e6008101a534 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:11.006808 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7a7d31e2-f83f-4d90-8b9f-e6008101a534 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:11.017094 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a7d31e2-f83f-4d90-8b9f-e6008101a534 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:11.017712 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a7d31e2-f83f-4d90-8b9f-e6008101a534 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:11.019285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a7d31e2-f83f-4d90-8b9f-e6008101a534 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:11.019891 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a7d31e2-f83f-4d90-8b9f-e6008101a534 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:11.130600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f05c266d-ca3b-499c-8369-e1baabc42757 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:11.131930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f05c266d-ca3b-499c-8369-e1baabc42757 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:11.147016 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f05c266d-ca3b-499c-8369-e1baabc42757 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:11.150646 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f05c266d-ca3b-499c-8369-e1baabc42757 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:11.151728 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f05c266d-ca3b-499c-8369-e1baabc42757 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:11.152488 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f05c266d-ca3b-499c-8369-e1baabc42757 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:11.413604 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7a7d31e2-f83f-4d90-8b9f-e6008101a534 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:11.430284 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7a7d31e2-f83f-4d90-8b9f-e6008101a534 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1314 microversion: 2.1 time: 0.440018 Jun 30 04:17:11.431144 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 116/246] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:10 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:11.444613 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-fe534ce8-92b5-4635-8ed8-de022da9f53d req-be1a73c8-765f-42fb-a9ac-9b2812302d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3f3442-a00e-47ee-b0df-f099086628ce", "name": "network-vif-plugged", "status": "completed", "tag": "bd404336-185f-4a39-8576-5211044a2340"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:11.462318 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-fe534ce8-92b5-4635-8ed8-de022da9f53d req-be1a73c8-765f-42fb-a9ac-9b2812302d14 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:11.462719 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-fe534ce8-92b5-4635-8ed8-de022da9f53d req-be1a73c8-765f-42fb-a9ac-9b2812302d14 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:11.500912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-fe534ce8-92b5-4635-8ed8-de022da9f53d req-be1a73c8-765f-42fb-a9ac-9b2812302d14 service nova] Creating event network-vif-plugged:bd404336-185f-4a39-8576-5211044a2340 for instance 2d3f3442-a00e-47ee-b0df-f099086628ce on hv-cinder-84684 Jun 30 04:17:11.512484 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-fe534ce8-92b5-4635-8ed8-de022da9f53d req-be1a73c8-765f-42fb-a9ac-9b2812302d14 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078321 Jun 30 04:17:11.515888 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 117/247] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:17:11.547740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f05c266d-ca3b-499c-8369-e1baabc42757 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:11.558259 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f05c266d-ca3b-499c-8369-e1baabc42757 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:11.562951 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f05c266d-ca3b-499c-8369-e1baabc42757 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:11.567976 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f05c266d-ca3b-499c-8369-e1baabc42757 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.439821 Jun 30 04:17:11.582480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 131/248] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:11 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:11.953894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2154914d-51bb-4c36-9ad7-82e961395b80 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:11.953894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2154914d-51bb-4c36-9ad7-82e961395b80 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:11.974948 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2154914d-51bb-4c36-9ad7-82e961395b80 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:11.978355 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2154914d-51bb-4c36-9ad7-82e961395b80 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:11.979529 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2154914d-51bb-4c36-9ad7-82e961395b80 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:11.980190 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2154914d-51bb-4c36-9ad7-82e961395b80 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:12.447680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-32a31ebc-e347-4ab5-9bbc-20caffcd11b9 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:12.448637 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-32a31ebc-e347-4ab5-9bbc-20caffcd11b9 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:12.467254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-32a31ebc-e347-4ab5-9bbc-20caffcd11b9 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:12.467962 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-32a31ebc-e347-4ab5-9bbc-20caffcd11b9 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:12.472999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-32a31ebc-e347-4ab5-9bbc-20caffcd11b9 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:12.476197 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-32a31ebc-e347-4ab5-9bbc-20caffcd11b9 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:12.648436 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2154914d-51bb-4c36-9ad7-82e961395b80 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:12.658543 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2154914d-51bb-4c36-9ad7-82e961395b80 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.713401 Jun 30 04:17:12.660642 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 118/249] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:11 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:12.672255 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ae3d8b1c-4683-4584-a9be-4eb23cb2fe89 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:12.673209 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ae3d8b1c-4683-4584-a9be-4eb23cb2fe89 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:12.689228 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ae3d8b1c-4683-4584-a9be-4eb23cb2fe89 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:12.690097 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ae3d8b1c-4683-4584-a9be-4eb23cb2fe89 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:12.691086 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ae3d8b1c-4683-4584-a9be-4eb23cb2fe89 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:12.691924 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ae3d8b1c-4683-4584-a9be-4eb23cb2fe89 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:12.955024 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ae3d8b1c-4683-4584-a9be-4eb23cb2fe89 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:12.966408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ae3d8b1c-4683-4584-a9be-4eb23cb2fe89 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:12.974126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ae3d8b1c-4683-4584-a9be-4eb23cb2fe89 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:12.975917 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ae3d8b1c-4683-4584-a9be-4eb23cb2fe89 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.309052 Jun 30 04:17:12.977026 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 119/250] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:12 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:12.996708 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-32a31ebc-e347-4ab5-9bbc-20caffcd11b9 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:13.006264 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-32a31ebc-e347-4ab5-9bbc-20caffcd11b9 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1464 microversion: 2.1 time: 0.563115 Jun 30 04:17:13.010635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 132/251] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:12 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1464 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:13.103042 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-50073ae9-bbeb-4458-9e19-4142748f0e11 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:13.103650 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-50073ae9-bbeb-4458-9e19-4142748f0e11 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:13.111713 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50073ae9-bbeb-4458-9e19-4142748f0e11 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:13.121744 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50073ae9-bbeb-4458-9e19-4142748f0e11 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:13.122914 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50073ae9-bbeb-4458-9e19-4142748f0e11 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:13.123467 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50073ae9-bbeb-4458-9e19-4142748f0e11 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:13.184253 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-50073ae9-bbeb-4458-9e19-4142748f0e11 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:17:13.314221 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:13.417977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-50073ae9-bbeb-4458-9e19-4142748f0e11 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 204 len: 0 microversion: 2.1 time: 0.318917 Jun 30 04:17:13.418691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 120/252] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:17:13 2022] DELETE /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:17:13.430047 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-487b8c7d-3869-48c3-b7e9-b42aaa3462c2 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:13.430583 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-487b8c7d-3869-48c3-b7e9-b42aaa3462c2 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:13.439087 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-487b8c7d-3869-48c3-b7e9-b42aaa3462c2 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:13.444635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-487b8c7d-3869-48c3-b7e9-b42aaa3462c2 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:13.454171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-487b8c7d-3869-48c3-b7e9-b42aaa3462c2 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:13.455709 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-487b8c7d-3869-48c3-b7e9-b42aaa3462c2 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:13.541856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-fc177b1f-8cf7-4e57-a133-9de7a28ebaed req-a48160e7-07f1-4c7f-83fd-1f7cd0cf75a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1faec7e8-1e39-47c4-aba5-2e67eaf2936c", "name": "network-vif-plugged", "status": "completed", "tag": "fca67734-6bd5-404d-9a44-a44b374bc3a8"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:13.561713 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-fc177b1f-8cf7-4e57-a133-9de7a28ebaed req-a48160e7-07f1-4c7f-83fd-1f7cd0cf75a2 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:13.562458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-fc177b1f-8cf7-4e57-a133-9de7a28ebaed req-a48160e7-07f1-4c7f-83fd-1f7cd0cf75a2 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:13.590031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-fc177b1f-8cf7-4e57-a133-9de7a28ebaed req-a48160e7-07f1-4c7f-83fd-1f7cd0cf75a2 service nova] Creating event network-vif-plugged:fca67734-6bd5-404d-9a44-a44b374bc3a8 for instance 1faec7e8-1e39-47c4-aba5-2e67eaf2936c on hv-cinder-84684 Jun 30 04:17:13.599230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-fc177b1f-8cf7-4e57-a133-9de7a28ebaed req-a48160e7-07f1-4c7f-83fd-1f7cd0cf75a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062119 Jun 30 04:17:13.612472 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 121/253] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:17:13.677215 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4d6eab07-7e9f-43bf-9029-8261b3702dab tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:13.678550 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4d6eab07-7e9f-43bf-9029-8261b3702dab tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:13.690403 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4d6eab07-7e9f-43bf-9029-8261b3702dab tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:13.693436 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4d6eab07-7e9f-43bf-9029-8261b3702dab tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:13.694382 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4d6eab07-7e9f-43bf-9029-8261b3702dab tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:13.695058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4d6eab07-7e9f-43bf-9029-8261b3702dab tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:13.781697 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-487b8c7d-3869-48c3-b7e9-b42aaa3462c2 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:13.800673 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-487b8c7d-3869-48c3-b7e9-b42aaa3462c2 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1470 microversion: 2.1 time: 0.374346 Jun 30 04:17:13.801977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 133/254] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:13 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:13.994786 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-73d1249c-a62c-4be3-9d64-48be008a8402 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:13.995426 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-73d1249c-a62c-4be3-9d64-48be008a8402 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:14.005015 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-73d1249c-a62c-4be3-9d64-48be008a8402 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:14.006978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4d6eab07-7e9f-43bf-9029-8261b3702dab tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:14.008000 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-73d1249c-a62c-4be3-9d64-48be008a8402 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:14.011707 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-73d1249c-a62c-4be3-9d64-48be008a8402 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:14.012311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-73d1249c-a62c-4be3-9d64-48be008a8402 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:14.015726 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4d6eab07-7e9f-43bf-9029-8261b3702dab tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.343200 Jun 30 04:17:14.020103 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 122/255] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:13 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:14.388421 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-73d1249c-a62c-4be3-9d64-48be008a8402 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:14.420769 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-73d1249c-a62c-4be3-9d64-48be008a8402 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:14.425549 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-73d1249c-a62c-4be3-9d64-48be008a8402 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:14.429763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-73d1249c-a62c-4be3-9d64-48be008a8402 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.438291 Jun 30 04:17:14.432679 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 134/256] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:13 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:17:14.818622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6faf7333-0d12-44f9-be9d-c05b0faca4a1 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:14.819556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6faf7333-0d12-44f9-be9d-c05b0faca4a1 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:14.833394 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6faf7333-0d12-44f9-be9d-c05b0faca4a1 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:14.834030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6faf7333-0d12-44f9-be9d-c05b0faca4a1 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:14.834978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6faf7333-0d12-44f9-be9d-c05b0faca4a1 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:14.835453 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6faf7333-0d12-44f9-be9d-c05b0faca4a1 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:15.040495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-11f71e07-993b-4268-9dc6-5e054fc36100 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:15.042212 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-11f71e07-993b-4268-9dc6-5e054fc36100 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:15.054405 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-11f71e07-993b-4268-9dc6-5e054fc36100 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:15.055292 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-11f71e07-993b-4268-9dc6-5e054fc36100 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:15.056319 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-11f71e07-993b-4268-9dc6-5e054fc36100 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:15.059226 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-11f71e07-993b-4268-9dc6-5e054fc36100 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:15.071877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=100 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:16.284859 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-11f71e07-993b-4268-9dc6-5e054fc36100 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:16.301908 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-11f71e07-993b-4268-9dc6-5e054fc36100 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 1.268701 Jun 30 04:17:16.313009 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 135/257] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:15 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:16.318454 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cf1d8188-2574-4faa-a8d6-60277ecb1dff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:16.327225 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cf1d8188-2574-4faa-a8d6-60277ecb1dff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:16.337457 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf1d8188-2574-4faa-a8d6-60277ecb1dff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:16.337894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf1d8188-2574-4faa-a8d6-60277ecb1dff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:16.338669 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf1d8188-2574-4faa-a8d6-60277ecb1dff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:16.339136 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf1d8188-2574-4faa-a8d6-60277ecb1dff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:16.407765 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6faf7333-0d12-44f9-be9d-c05b0faca4a1 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:16.430399 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6faf7333-0d12-44f9-be9d-c05b0faca4a1 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1470 microversion: 2.1 time: 1.613335 Jun 30 04:17:16.431034 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 123/258] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:14 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1470 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:17.012867 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-b8e19ac6-e20c-4577-9cb6-98500aceaaea req-56852609-b243-4cf1-8e30-0c8996a4318f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13", "name": "network-vif-deleted", "tag": "14681158-c69f-4840-927a-2a8907e26393"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:17.013444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cf1d8188-2574-4faa-a8d6-60277ecb1dff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:17.026446 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cf1d8188-2574-4faa-a8d6-60277ecb1dff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:17.028022 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cf1d8188-2574-4faa-a8d6-60277ecb1dff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:17.029254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cf1d8188-2574-4faa-a8d6-60277ecb1dff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.715067 Jun 30 04:17:17.054659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 136/259] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:16 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:17.066491 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-b8e19ac6-e20c-4577-9cb6-98500aceaaea req-56852609-b243-4cf1-8e30-0c8996a4318f service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:17.067536 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-b8e19ac6-e20c-4577-9cb6-98500aceaaea req-56852609-b243-4cf1-8e30-0c8996a4318f service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:17.108693 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-b8e19ac6-e20c-4577-9cb6-98500aceaaea req-56852609-b243-4cf1-8e30-0c8996a4318f service nova] Creating event network-vif-deleted:14681158-c69f-4840-927a-2a8907e26393 for instance d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 on hv-cinder-84684 Jun 30 04:17:17.127033 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-b8e19ac6-e20c-4577-9cb6-98500aceaaea req-56852609-b243-4cf1-8e30-0c8996a4318f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114591 Jun 30 04:17:17.128559 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 124/260] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:17:17.319606 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-84046db3-1745-418f-90b9-6a3a2f870578 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:17.321259 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-84046db3-1745-418f-90b9-6a3a2f870578 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:17.332035 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-84046db3-1745-418f-90b9-6a3a2f870578 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:17.336550 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-84046db3-1745-418f-90b9-6a3a2f870578 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:17.337680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-84046db3-1745-418f-90b9-6a3a2f870578 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:17.338189 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-84046db3-1745-418f-90b9-6a3a2f870578 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:17.453876 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:17.455696 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:17.476641 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:17.477480 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:17.479015 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:17.479631 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:17.587601 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-84046db3-1745-418f-90b9-6a3a2f870578 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:17.607849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-84046db3-1745-418f-90b9-6a3a2f870578 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1321 microversion: 2.1 time: 0.292126 Jun 30 04:17:17.619221 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:17.619956 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:17.620180 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 137/261] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:17 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:17.631301 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lazy-loading 'fault' on Instance uuid d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:17:17.705058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c1fc524bf4b82b8662fe02748c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec13c3f4a04d688912b49eb43a02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:17.719595 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5392caf4-da4e-4802-8d04-7a1440e01e41 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 200 len: 1304 microversion: 2.1 time: 0.274530 Jun 30 04:17:17.723588 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 125/262] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:17 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 1304 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:17:18.054078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-605a36db-31ba-4c9e-9bb9-24a0230f9cc8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:18.054993 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-605a36db-31ba-4c9e-9bb9-24a0230f9cc8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:18.075953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-605a36db-31ba-4c9e-9bb9-24a0230f9cc8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:18.077841 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-605a36db-31ba-4c9e-9bb9-24a0230f9cc8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:18.080240 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-605a36db-31ba-4c9e-9bb9-24a0230f9cc8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:18.081704 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-605a36db-31ba-4c9e-9bb9-24a0230f9cc8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:18.636669 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6f2182be-756a-405f-943d-8e19a74d9098 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:18.637516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6f2182be-756a-405f-943d-8e19a74d9098 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:18.649345 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6f2182be-756a-405f-943d-8e19a74d9098 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:18.649903 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6f2182be-756a-405f-943d-8e19a74d9098 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:18.650863 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6f2182be-756a-405f-943d-8e19a74d9098 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:18.653113 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6f2182be-756a-405f-943d-8e19a74d9098 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:18.668766 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-605a36db-31ba-4c9e-9bb9-24a0230f9cc8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:18.679172 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-605a36db-31ba-4c9e-9bb9-24a0230f9cc8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:18.701825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-605a36db-31ba-4c9e-9bb9-24a0230f9cc8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:18.708220 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-605a36db-31ba-4c9e-9bb9-24a0230f9cc8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.660610 Jun 30 04:17:18.723123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 138/263] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:18 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:18.739337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-552caedf-995b-44dc-adc2-a2fc5308a528 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:18.739954 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-552caedf-995b-44dc-adc2-a2fc5308a528 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] [instance: d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:18.749056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-552caedf-995b-44dc-adc2-a2fc5308a528 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:18.749503 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-552caedf-995b-44dc-adc2-a2fc5308a528 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:18.750279 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-552caedf-995b-44dc-adc2-a2fc5308a528 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:18.750710 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-552caedf-995b-44dc-adc2-a2fc5308a528 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:18.786261 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-552caedf-995b-44dc-adc2-a2fc5308a528 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] HTTP exception thrown: Instance d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 could not be found. Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-552caedf-995b-44dc-adc2-a2fc5308a528 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Request method failure captured: Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 HTTP/1.1 Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSOpNCKbTY99unFQzqZG0prJT4pC6U_NAcxfFOlJb_RlwaINP7I9I2UEiZQWMN_VcNY_13Mlhw3046rzf2eBzlxSLiKSKNrE1frVfNSgwXZQ9FruyW1ZpQbhZppWVsOn7WL-9BvRo1vUGWyVRR6r_ddF4DeKPLTGwuQOO_j1jakgQa8 Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 29ec13c3f4a04d688912b49eb43a02e6 Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-VolumesNegativeTest-991117380 Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:17:18.788556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/29ec13c3f4a04d688912b49eb43a02e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_29ec13c3f4a04d688912b49eb43a02e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/29ec13c3f4a04d688912b49eb43a02e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/29ec13c3f4a04d688912b49eb43a02e6"}]}] Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-VolumesNegativeTest-991117380 Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 29ec13c3f4a04d688912b49eb43a02e6 Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-VolumesNegativeTest-991117380 Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-VolumesNegativeTest-991117380-project Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: 211c1fc524bf4b82b8662fe02748c815 Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-VolumesNegativeTest-991117380-project Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 could not be found. Jun 30 04:17:18.790017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': 'd6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13'} Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 could not be found. Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:17:18.790796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 could not be found. Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 could not be found. Jun 30 04:17:18.792252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:17:18.793355 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-552caedf-995b-44dc-adc2-a2fc5308a528 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] Returning 404 to user: Instance d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:17:18.793355 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-552caedf-995b-44dc-adc2-a2fc5308a528 tempest-VolumesNegativeTest-991117380 tempest-VolumesNegativeTest-991117380-project] 10.222.0.13 "GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13" status: 404 len: 111 microversion: 2.1 time: 0.057509 Jun 30 04:17:18.793718 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 139/264] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:18 2022] GET /compute/v2.1/servers/d6f86ca2-4b47-4bbb-bc3a-bb0a9db0cd13 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:17:18.984537 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6f2182be-756a-405f-943d-8e19a74d9098 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:18.993427 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6f2182be-756a-405f-943d-8e19a74d9098 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1515 microversion: 2.1 time: 0.360560 Jun 30 04:17:18.994031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 126/265] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:18 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1515 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:17:19.012230 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-79eb35f4-8b2a-42b7-9a6c-7db0745bc177 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:19.013556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-79eb35f4-8b2a-42b7-9a6c-7db0745bc177 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:19.037449 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-79eb35f4-8b2a-42b7-9a6c-7db0745bc177 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:19.043037 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-79eb35f4-8b2a-42b7-9a6c-7db0745bc177 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:19.054539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-79eb35f4-8b2a-42b7-9a6c-7db0745bc177 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:19.054978 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-79eb35f4-8b2a-42b7-9a6c-7db0745bc177 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:19.177954 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-79eb35f4-8b2a-42b7-9a6c-7db0745bc177 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lazy-loading 'flavor' on Instance uuid 1faec7e8-1e39-47c4-aba5-2e67eaf2936c {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:17:19.367687 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-79eb35f4-8b2a-42b7-9a6c-7db0745bc177 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c/action" status: 200 len: 32 microversion: 2.1 time: 0.359958 Jun 30 04:17:19.368628 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 140/266] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:17:19 2022] POST /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 04:17:19.378426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-874e0980-6ed0-41d2-a902-a8c4412eb392 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:19.379033 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-874e0980-6ed0-41d2-a902-a8c4412eb392 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:19.390501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-874e0980-6ed0-41d2-a902-a8c4412eb392 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:19.392416 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-874e0980-6ed0-41d2-a902-a8c4412eb392 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:19.393399 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-874e0980-6ed0-41d2-a902-a8c4412eb392 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:19.398151 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-874e0980-6ed0-41d2-a902-a8c4412eb392 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:19.732451 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a810a4a1-88f4-4784-b1d8-a68082a1b1e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:19.734041 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a810a4a1-88f4-4784-b1d8-a68082a1b1e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:19.753712 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a810a4a1-88f4-4784-b1d8-a68082a1b1e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:19.756899 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a810a4a1-88f4-4784-b1d8-a68082a1b1e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:19.759830 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a810a4a1-88f4-4784-b1d8-a68082a1b1e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:19.762835 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a810a4a1-88f4-4784-b1d8-a68082a1b1e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:20.145553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a810a4a1-88f4-4784-b1d8-a68082a1b1e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:20.155232 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a810a4a1-88f4-4784-b1d8-a68082a1b1e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:20.160763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a810a4a1-88f4-4784-b1d8-a68082a1b1e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:20.170829 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-874e0980-6ed0-41d2-a902-a8c4412eb392 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:20.185709 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a810a4a1-88f4-4784-b1d8-a68082a1b1e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.461006 Jun 30 04:17:20.189509 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-874e0980-6ed0-41d2-a902-a8c4412eb392 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.815238 Jun 30 04:17:20.190138 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 141/267] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:19 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:20.193725 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 127/268] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:19 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:21.217836 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5888227e-8bbd-4649-99d0-fc355d2f2d6e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:21.218442 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5888227e-8bbd-4649-99d0-fc355d2f2d6e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:21.227511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d94d180a-622b-4253-ace6-4b0b25adef9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:21.229146 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d94d180a-622b-4253-ace6-4b0b25adef9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:21.238234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5888227e-8bbd-4649-99d0-fc355d2f2d6e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:21.238687 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5888227e-8bbd-4649-99d0-fc355d2f2d6e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:21.243703 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5888227e-8bbd-4649-99d0-fc355d2f2d6e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:21.244174 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5888227e-8bbd-4649-99d0-fc355d2f2d6e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:21.245022 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d94d180a-622b-4253-ace6-4b0b25adef9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:21.249534 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d94d180a-622b-4253-ace6-4b0b25adef9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:21.250601 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d94d180a-622b-4253-ace6-4b0b25adef9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:21.251310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d94d180a-622b-4253-ace6-4b0b25adef9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:21.593193 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5888227e-8bbd-4649-99d0-fc355d2f2d6e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:21.603210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5888227e-8bbd-4649-99d0-fc355d2f2d6e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:21.607509 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5888227e-8bbd-4649-99d0-fc355d2f2d6e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:21.611762 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5888227e-8bbd-4649-99d0-fc355d2f2d6e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.397773 Jun 30 04:17:21.613055 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 142/269] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:21 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:21.929983 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d94d180a-622b-4253-ace6-4b0b25adef9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:21.939085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d94d180a-622b-4253-ace6-4b0b25adef9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.719237 Jun 30 04:17:21.941211 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 128/270] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:21 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:22.630483 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-187ecff4-9ef3-43c9-9c0b-6fd9f482e1fa tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:22.631162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-187ecff4-9ef3-43c9-9c0b-6fd9f482e1fa tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:22.645411 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-187ecff4-9ef3-43c9-9c0b-6fd9f482e1fa tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:22.645876 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-187ecff4-9ef3-43c9-9c0b-6fd9f482e1fa tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:22.646932 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-187ecff4-9ef3-43c9-9c0b-6fd9f482e1fa tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:22.647647 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-187ecff4-9ef3-43c9-9c0b-6fd9f482e1fa tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:22.911865 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-187ecff4-9ef3-43c9-9c0b-6fd9f482e1fa tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:22.928320 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-187ecff4-9ef3-43c9-9c0b-6fd9f482e1fa tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:22.930204 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-187ecff4-9ef3-43c9-9c0b-6fd9f482e1fa tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:22.936063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-187ecff4-9ef3-43c9-9c0b-6fd9f482e1fa tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.309905 Jun 30 04:17:22.937086 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 143/271] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:22 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:22.957308 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b187decc-37b0-48c6-95a8-1486905d9369 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:22.959357 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b187decc-37b0-48c6-95a8-1486905d9369 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:22.973950 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b187decc-37b0-48c6-95a8-1486905d9369 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:22.975628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b187decc-37b0-48c6-95a8-1486905d9369 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:22.976577 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b187decc-37b0-48c6-95a8-1486905d9369 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:22.981159 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b187decc-37b0-48c6-95a8-1486905d9369 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:23.319792 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b187decc-37b0-48c6-95a8-1486905d9369 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:23.328517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b187decc-37b0-48c6-95a8-1486905d9369 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.375943 Jun 30 04:17:23.329475 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 129/272] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:22 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:23.959246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0dc68a37-5d06-4189-9986-6c8c37f67dec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:23.961719 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0dc68a37-5d06-4189-9986-6c8c37f67dec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:23.976331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dc68a37-5d06-4189-9986-6c8c37f67dec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:23.979794 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dc68a37-5d06-4189-9986-6c8c37f67dec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:23.980928 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dc68a37-5d06-4189-9986-6c8c37f67dec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:23.983322 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dc68a37-5d06-4189-9986-6c8c37f67dec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:24.186974 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0dc68a37-5d06-4189-9986-6c8c37f67dec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:24.202157 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0dc68a37-5d06-4189-9986-6c8c37f67dec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:24.204528 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0dc68a37-5d06-4189-9986-6c8c37f67dec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:24.206735 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0dc68a37-5d06-4189-9986-6c8c37f67dec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.254830 Jun 30 04:17:24.219886 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 144/273] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:23 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:24.347490 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9bcef955-012c-4ded-ba64-29521cc34ecb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:24.355262 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9bcef955-012c-4ded-ba64-29521cc34ecb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:24.381725 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bcef955-012c-4ded-ba64-29521cc34ecb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:24.390693 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bcef955-012c-4ded-ba64-29521cc34ecb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:24.392508 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bcef955-012c-4ded-ba64-29521cc34ecb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:24.393193 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bcef955-012c-4ded-ba64-29521cc34ecb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:24.744051 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9bcef955-012c-4ded-ba64-29521cc34ecb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:24.758155 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9bcef955-012c-4ded-ba64-29521cc34ecb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.415794 Jun 30 04:17:24.759700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 130/274] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:24 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:25.226032 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d52e48be-6696-498c-ab8d-588029aa1632 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:25.227556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d52e48be-6696-498c-ab8d-588029aa1632 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:25.234821 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d52e48be-6696-498c-ab8d-588029aa1632 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:25.235740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d52e48be-6696-498c-ab8d-588029aa1632 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:25.237297 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d52e48be-6696-498c-ab8d-588029aa1632 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:25.238056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d52e48be-6696-498c-ab8d-588029aa1632 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:25.540726 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d52e48be-6696-498c-ab8d-588029aa1632 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:25.571692 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d52e48be-6696-498c-ab8d-588029aa1632 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:25.574150 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d52e48be-6696-498c-ab8d-588029aa1632 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:25.575650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d52e48be-6696-498c-ab8d-588029aa1632 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.353800 Jun 30 04:17:25.588053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 145/275] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:25 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:25.776682 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7c2c6c81-8103-456a-abc0-f4f1d96e3761 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:25.777257 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7c2c6c81-8103-456a-abc0-f4f1d96e3761 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:25.795525 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c2c6c81-8103-456a-abc0-f4f1d96e3761 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:25.796346 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c2c6c81-8103-456a-abc0-f4f1d96e3761 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:25.797319 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c2c6c81-8103-456a-abc0-f4f1d96e3761 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:25.798036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c2c6c81-8103-456a-abc0-f4f1d96e3761 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:26.069443 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7c2c6c81-8103-456a-abc0-f4f1d96e3761 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:26.086590 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7c2c6c81-8103-456a-abc0-f4f1d96e3761 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.313320 Jun 30 04:17:26.087504 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 131/276] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:25 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:26.595535 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-804637b6-6de6-47e0-8173-9d4e38b27f76 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:26.596702 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-804637b6-6de6-47e0-8173-9d4e38b27f76 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:26.611178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-804637b6-6de6-47e0-8173-9d4e38b27f76 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:26.611839 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-804637b6-6de6-47e0-8173-9d4e38b27f76 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:26.613731 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-804637b6-6de6-47e0-8173-9d4e38b27f76 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:26.616843 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-804637b6-6de6-47e0-8173-9d4e38b27f76 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:26.971282 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-804637b6-6de6-47e0-8173-9d4e38b27f76 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:26.984429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-804637b6-6de6-47e0-8173-9d4e38b27f76 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:26.986872 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-804637b6-6de6-47e0-8173-9d4e38b27f76 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:26.991755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-804637b6-6de6-47e0-8173-9d4e38b27f76 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.401176 Jun 30 04:17:26.992963 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 146/277] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:26 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:27.105886 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5f7322c4-9363-4e7e-9195-57e83056daa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:27.107068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5f7322c4-9363-4e7e-9195-57e83056daa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:27.131075 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f7322c4-9363-4e7e-9195-57e83056daa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:27.132226 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f7322c4-9363-4e7e-9195-57e83056daa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:27.133230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f7322c4-9363-4e7e-9195-57e83056daa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:27.133809 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f7322c4-9363-4e7e-9195-57e83056daa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:27.457282 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5f7322c4-9363-4e7e-9195-57e83056daa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:27.466804 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5f7322c4-9363-4e7e-9195-57e83056daa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.365651 Jun 30 04:17:27.477231 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 132/278] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:27 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:28.010016 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0bf5761b-4b26-4afb-9694-ea6504e2a9f6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:28.010647 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0bf5761b-4b26-4afb-9694-ea6504e2a9f6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:28.027645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0bf5761b-4b26-4afb-9694-ea6504e2a9f6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:28.028164 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0bf5761b-4b26-4afb-9694-ea6504e2a9f6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:28.029030 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0bf5761b-4b26-4afb-9694-ea6504e2a9f6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:28.029541 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0bf5761b-4b26-4afb-9694-ea6504e2a9f6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:28.498924 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-485732b0-2056-49f3-ac55-4a2026547b7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:28.499841 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-485732b0-2056-49f3-ac55-4a2026547b7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:28.516211 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0bf5761b-4b26-4afb-9694-ea6504e2a9f6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:28.526134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-485732b0-2056-49f3-ac55-4a2026547b7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:28.534472 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-485732b0-2056-49f3-ac55-4a2026547b7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:28.536605 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-485732b0-2056-49f3-ac55-4a2026547b7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:28.539523 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-485732b0-2056-49f3-ac55-4a2026547b7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:28.582379 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0bf5761b-4b26-4afb-9694-ea6504e2a9f6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:28.584437 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0bf5761b-4b26-4afb-9694-ea6504e2a9f6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:28.586048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0bf5761b-4b26-4afb-9694-ea6504e2a9f6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.579957 Jun 30 04:17:28.587147 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 147/279] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:28 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:28.989586 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-485732b0-2056-49f3-ac55-4a2026547b7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:29.000020 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-485732b0-2056-49f3-ac55-4a2026547b7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.508200 Jun 30 04:17:29.000910 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 133/280] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:28 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:29.613607 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0dbddea4-b9f2-4645-95b5-e7eabdea807a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:29.615383 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0dbddea4-b9f2-4645-95b5-e7eabdea807a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:29.639740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=73 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:29.642112 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dbddea4-b9f2-4645-95b5-e7eabdea807a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:29.643056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dbddea4-b9f2-4645-95b5-e7eabdea807a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:29.644085 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dbddea4-b9f2-4645-95b5-e7eabdea807a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:29.644739 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dbddea4-b9f2-4645-95b5-e7eabdea807a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:30.020998 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3041ff54-22e4-4677-8ac4-56b824a01df2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:30.021663 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3041ff54-22e4-4677-8ac4-56b824a01df2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:30.043243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3041ff54-22e4-4677-8ac4-56b824a01df2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:30.044359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3041ff54-22e4-4677-8ac4-56b824a01df2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:30.045383 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3041ff54-22e4-4677-8ac4-56b824a01df2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:30.045986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3041ff54-22e4-4677-8ac4-56b824a01df2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:30.178771 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0dbddea4-b9f2-4645-95b5-e7eabdea807a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:30.187937 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0dbddea4-b9f2-4645-95b5-e7eabdea807a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:30.193118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0dbddea4-b9f2-4645-95b5-e7eabdea807a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:30.198132 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0dbddea4-b9f2-4645-95b5-e7eabdea807a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.594230 Jun 30 04:17:30.199058 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 148/281] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:29 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:30.504957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3041ff54-22e4-4677-8ac4-56b824a01df2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:30.539392 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3041ff54-22e4-4677-8ac4-56b824a01df2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.521675 Jun 30 04:17:30.540392 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 134/282] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:30 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:17:31.218270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3f9af435-0d40-42e8-99ba-3bc63ccea193 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:31.220339 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3f9af435-0d40-42e8-99ba-3bc63ccea193 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:31.239671 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3f9af435-0d40-42e8-99ba-3bc63ccea193 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:31.240485 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3f9af435-0d40-42e8-99ba-3bc63ccea193 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:31.242698 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3f9af435-0d40-42e8-99ba-3bc63ccea193 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:31.248880 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3f9af435-0d40-42e8-99ba-3bc63ccea193 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:31.558229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ef46fac7-8fb5-4e6a-9653-16c2cee506d4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:31.560217 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ef46fac7-8fb5-4e6a-9653-16c2cee506d4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:31.573842 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:31.581457 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef46fac7-8fb5-4e6a-9653-16c2cee506d4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:31.584463 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef46fac7-8fb5-4e6a-9653-16c2cee506d4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:31.586555 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef46fac7-8fb5-4e6a-9653-16c2cee506d4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:31.587052 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef46fac7-8fb5-4e6a-9653-16c2cee506d4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:31.853151 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3f9af435-0d40-42e8-99ba-3bc63ccea193 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:31.863081 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3f9af435-0d40-42e8-99ba-3bc63ccea193 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:31.864932 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3f9af435-0d40-42e8-99ba-3bc63ccea193 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:31.867480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3f9af435-0d40-42e8-99ba-3bc63ccea193 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1740 microversion: 2.20 time: 0.654300 Jun 30 04:17:31.868565 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 149/283] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:31 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1740 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:31.924922 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ef46fac7-8fb5-4e6a-9653-16c2cee506d4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:31.937582 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ef46fac7-8fb5-4e6a-9653-16c2cee506d4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.384870 Jun 30 04:17:31.939989 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 135/284] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:31 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:32.888309 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-30493517-3813-4bfc-953e-0f33c5b09325 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:32.889703 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-30493517-3813-4bfc-953e-0f33c5b09325 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:32.896958 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-30493517-3813-4bfc-953e-0f33c5b09325 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:32.897405 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-30493517-3813-4bfc-953e-0f33c5b09325 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:32.898180 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-30493517-3813-4bfc-953e-0f33c5b09325 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:32.898612 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-30493517-3813-4bfc-953e-0f33c5b09325 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:32.926455 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:32.957584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-108a2320-a0fa-4186-b964-b1a236758ba5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:32.958280 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-108a2320-a0fa-4186-b964-b1a236758ba5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:32.965174 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-108a2320-a0fa-4186-b964-b1a236758ba5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:32.965618 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-108a2320-a0fa-4186-b964-b1a236758ba5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:32.966583 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-108a2320-a0fa-4186-b964-b1a236758ba5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:32.967010 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-108a2320-a0fa-4186-b964-b1a236758ba5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:33.324338 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-30493517-3813-4bfc-953e-0f33c5b09325 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:33.336580 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-30493517-3813-4bfc-953e-0f33c5b09325 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:33.338125 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-30493517-3813-4bfc-953e-0f33c5b09325 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:33.339531 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-30493517-3813-4bfc-953e-0f33c5b09325 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1722 microversion: 2.20 time: 0.457216 Jun 30 04:17:33.347874 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 150/285] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:32 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1722 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:33.359493 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-108a2320-a0fa-4186-b964-b1a236758ba5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:33.386188 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-108a2320-a0fa-4186-b964-b1a236758ba5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.433973 Jun 30 04:17:33.387189 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 136/286] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:32 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:17:34.216626 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-20324e4a-e028-4536-8e20-ddeebc9cde91 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Action: 'create', calling method: .version_select at 0x7fb480352a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-576365692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbQLgzGgnNE1P7ZTS0F/MaIUAWYd9U6KqS1hQyDZKHEOKZPYP95JQLogfZ8JVvGTj510lXlYsmWcugla3/miiJ1vwqkusDenaPGuFVPdQK0lP5ZX/qZgG0QRxKE7lhV2w=="}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:34.232225 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-20324e4a-e028-4536-8e20-ddeebc9cde91 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Getting quotas for project 62d0dd3cae1448049dc95fb347fd1a80. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:17:34.236641 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-20324e4a-e028-4536-8e20-ddeebc9cde91 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Getting quotas for user ebfcd2137bf94726a25fea389ef24430 and project 62d0dd3cae1448049dc95fb347fd1a80. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:17:34.262949 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-20324e4a-e028-4536-8e20-ddeebc9cde91 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.211732 Jun 30 04:17:34.263596 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 151/287] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 30 04:17:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:17:34.358239 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d4d98f4d-dbe1-4995-85a8-0365b27575ee tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:34.358838 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d4d98f4d-dbe1-4995-85a8-0365b27575ee tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:34.365912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4d98f4d-dbe1-4995-85a8-0365b27575ee tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:34.366272 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4d98f4d-dbe1-4995-85a8-0365b27575ee tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:34.367013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4d98f4d-dbe1-4995-85a8-0365b27575ee tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:34.367632 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4d98f4d-dbe1-4995-85a8-0365b27575ee tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:34.404904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cb56d77f-800a-4880-a06e-e0a6c913735b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:34.405547 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cb56d77f-800a-4880-a06e-e0a6c913735b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:34.413064 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cb56d77f-800a-4880-a06e-e0a6c913735b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:34.413751 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cb56d77f-800a-4880-a06e-e0a6c913735b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:34.414678 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cb56d77f-800a-4880-a06e-e0a6c913735b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:34.415167 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cb56d77f-800a-4880-a06e-e0a6c913735b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:34.599405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d4d98f4d-dbe1-4995-85a8-0365b27575ee tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:34.601840 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cb56d77f-800a-4880-a06e-e0a6c913735b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:34.606101 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:34.611134 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cb56d77f-800a-4880-a06e-e0a6c913735b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.209947 Jun 30 04:17:34.620315 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 152/288] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:34 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:34.621113 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d4d98f4d-dbe1-4995-85a8-0365b27575ee tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:34.621349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d4d98f4d-dbe1-4995-85a8-0365b27575ee tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:34.622790 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d4d98f4d-dbe1-4995-85a8-0365b27575ee tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1722 microversion: 2.20 time: 0.268532 Jun 30 04:17:34.623403 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 137/289] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:34 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:35.628487 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a31a99d1-721a-429d-9b30-2efc0efe22c5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:35.629893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a31a99d1-721a-429d-9b30-2efc0efe22c5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:35.639448 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a31a99d1-721a-429d-9b30-2efc0efe22c5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:35.639901 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a31a99d1-721a-429d-9b30-2efc0efe22c5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:35.640671 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a31a99d1-721a-429d-9b30-2efc0efe22c5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:35.641106 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a31a99d1-721a-429d-9b30-2efc0efe22c5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:35.643416 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7a5edd3-f73f-4d1a-9817-fcf68b393e30 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:35.644663 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a7a5edd3-f73f-4d1a-9817-fcf68b393e30 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:35.655317 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7a5edd3-f73f-4d1a-9817-fcf68b393e30 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:35.655977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7a5edd3-f73f-4d1a-9817-fcf68b393e30 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:35.657121 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7a5edd3-f73f-4d1a-9817-fcf68b393e30 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:35.660582 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7a5edd3-f73f-4d1a-9817-fcf68b393e30 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:35.986056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a31a99d1-721a-429d-9b30-2efc0efe22c5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:35.997464 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a31a99d1-721a-429d-9b30-2efc0efe22c5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.372806 Jun 30 04:17:36.010247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 153/290] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:35 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:36.074491 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a7a5edd3-f73f-4d1a-9817-fcf68b393e30 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:36.091209 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a7a5edd3-f73f-4d1a-9817-fcf68b393e30 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:36.092909 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a7a5edd3-f73f-4d1a-9817-fcf68b393e30 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:36.095428 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a7a5edd3-f73f-4d1a-9817-fcf68b393e30 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1722 microversion: 2.20 time: 0.457975 Jun 30 04:17:36.099195 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 138/291] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:35 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1722 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:17:36.925889 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-98ee3489-571f-493b-880b-5e0b41223731 req-c74704b9-c7c8-4495-801d-1a174582facd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3f3442-a00e-47ee-b0df-f099086628ce", "name": "network-vif-unplugged", "status": "completed", "tag": "bd404336-185f-4a39-8576-5211044a2340"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:36.947142 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-98ee3489-571f-493b-880b-5e0b41223731 req-c74704b9-c7c8-4495-801d-1a174582facd service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:36.947683 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-98ee3489-571f-493b-880b-5e0b41223731 req-c74704b9-c7c8-4495-801d-1a174582facd service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:36.964441 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-98ee3489-571f-493b-880b-5e0b41223731 req-c74704b9-c7c8-4495-801d-1a174582facd service nova] Creating event network-vif-unplugged:bd404336-185f-4a39-8576-5211044a2340 for instance 2d3f3442-a00e-47ee-b0df-f099086628ce on hv-cinder-84684 Jun 30 04:17:36.979734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-98ee3489-571f-493b-880b-5e0b41223731 req-c74704b9-c7c8-4495-801d-1a174582facd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058280 Jun 30 04:17:36.981081 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 154/292] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:17:37.017581 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-81895a95-c444-4e14-a6a5-b280084aa98a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:37.018914 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-81895a95-c444-4e14-a6a5-b280084aa98a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:37.029824 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81895a95-c444-4e14-a6a5-b280084aa98a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:37.035037 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81895a95-c444-4e14-a6a5-b280084aa98a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:37.036065 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81895a95-c444-4e14-a6a5-b280084aa98a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:37.039968 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81895a95-c444-4e14-a6a5-b280084aa98a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:37.134113 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f9d35cfb-86ea-480a-9d96-0ea35089bbe8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:37.135397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f9d35cfb-86ea-480a-9d96-0ea35089bbe8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:37.149317 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9d35cfb-86ea-480a-9d96-0ea35089bbe8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:37.149763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9d35cfb-86ea-480a-9d96-0ea35089bbe8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:37.153718 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9d35cfb-86ea-480a-9d96-0ea35089bbe8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:37.155626 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9d35cfb-86ea-480a-9d96-0ea35089bbe8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:37.476831 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-81895a95-c444-4e14-a6a5-b280084aa98a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:37.505000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-81895a95-c444-4e14-a6a5-b280084aa98a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.492581 Jun 30 04:17:37.513754 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 139/293] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:37 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:37.574424 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f9d35cfb-86ea-480a-9d96-0ea35089bbe8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:37.588104 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f9d35cfb-86ea-480a-9d96-0ea35089bbe8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:37.592557 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f9d35cfb-86ea-480a-9d96-0ea35089bbe8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:37.595259 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f9d35cfb-86ea-480a-9d96-0ea35089bbe8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1722 microversion: 2.20 time: 0.481218 Jun 30 04:17:37.598440 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 155/294] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:37 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:17:38.522246 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-83b24b61-1718-4964-aa2b-9a1698a0e8dc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:38.522865 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-83b24b61-1718-4964-aa2b-9a1698a0e8dc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:38.529822 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83b24b61-1718-4964-aa2b-9a1698a0e8dc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:38.530421 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83b24b61-1718-4964-aa2b-9a1698a0e8dc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:38.531278 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83b24b61-1718-4964-aa2b-9a1698a0e8dc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:38.531724 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83b24b61-1718-4964-aa2b-9a1698a0e8dc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:38.615141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7d61d7a9-c7a6-46d1-8815-90e2f20c740a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:38.615769 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7d61d7a9-c7a6-46d1-8815-90e2f20c740a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:38.622179 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d61d7a9-c7a6-46d1-8815-90e2f20c740a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:38.622618 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d61d7a9-c7a6-46d1-8815-90e2f20c740a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:38.623395 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d61d7a9-c7a6-46d1-8815-90e2f20c740a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:38.623821 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d61d7a9-c7a6-46d1-8815-90e2f20c740a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:38.771695 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-83b24b61-1718-4964-aa2b-9a1698a0e8dc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:38.779283 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-83b24b61-1718-4964-aa2b-9a1698a0e8dc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.260900 Jun 30 04:17:38.779782 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 140/295] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:38 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:38.832809 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7d61d7a9-c7a6-46d1-8815-90e2f20c740a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:38.841233 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7d61d7a9-c7a6-46d1-8815-90e2f20c740a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:38.842761 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7d61d7a9-c7a6-46d1-8815-90e2f20c740a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:38.843962 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7d61d7a9-c7a6-46d1-8815-90e2f20c740a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1665 microversion: 2.20 time: 0.232823 Jun 30 04:17:38.844554 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 156/296] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:38 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1665 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:38.863030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dfe2f9bf-0377-48ef-8537-86fdeaa54fe4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a17e55b-8778-4e39-821f-a8456a029b07"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:38.864548 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dfe2f9bf-0377-48ef-8537-86fdeaa54fe4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:38.872493 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dfe2f9bf-0377-48ef-8537-86fdeaa54fe4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:38.874205 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dfe2f9bf-0377-48ef-8537-86fdeaa54fe4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:38.875697 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dfe2f9bf-0377-48ef-8537-86fdeaa54fe4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:38.876389 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dfe2f9bf-0377-48ef-8537-86fdeaa54fe4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:39.255464 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dfe2f9bf-0377-48ef-8537-86fdeaa54fe4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "POST /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.397109 Jun 30 04:17:39.256246 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 141/297] 10.222.0.13 () {62 vars in 1363 bytes} [Thu Jun 30 04:17:38 2022] POST /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments => generated 188 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:17:39.389312 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1e08a202-346d-401f-8faf-4d336dce869e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:39.389933 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1e08a202-346d-401f-8faf-4d336dce869e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:39.396364 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1e08a202-346d-401f-8faf-4d336dce869e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:39.397074 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1e08a202-346d-401f-8faf-4d336dce869e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:39.398042 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1e08a202-346d-401f-8faf-4d336dce869e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:39.398500 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1e08a202-346d-401f-8faf-4d336dce869e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:39.670427 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1e08a202-346d-401f-8faf-4d336dce869e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "POST /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/action" status: 202 len: 0 microversion: 2.20 time: 0.290558 Jun 30 04:17:39.672108 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 157/298] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 30 04:17:39 2022] POST /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:17:39.680840 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a6eb974a-6d3d-4786-bd63-38a764897d63 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:39.682198 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a6eb974a-6d3d-4786-bd63-38a764897d63 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:39.690778 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6eb974a-6d3d-4786-bd63-38a764897d63 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:39.691276 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6eb974a-6d3d-4786-bd63-38a764897d63 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:39.692227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6eb974a-6d3d-4786-bd63-38a764897d63 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:39.692662 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6eb974a-6d3d-4786-bd63-38a764897d63 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:39.802989 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f20ece76-9e87-47f8-b951-efe3746684a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:39.804445 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f20ece76-9e87-47f8-b951-efe3746684a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:39.819238 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f20ece76-9e87-47f8-b951-efe3746684a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:39.819710 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f20ece76-9e87-47f8-b951-efe3746684a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:39.821493 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f20ece76-9e87-47f8-b951-efe3746684a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:39.821940 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f20ece76-9e87-47f8-b951-efe3746684a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:39.862848 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a6eb974a-6d3d-4786-bd63-38a764897d63 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:39.875316 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a6eb974a-6d3d-4786-bd63-38a764897d63 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:39.878288 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a6eb974a-6d3d-4786-bd63-38a764897d63 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:39.879771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a6eb974a-6d3d-4786-bd63-38a764897d63 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1751 microversion: 2.20 time: 0.203315 Jun 30 04:17:39.880512 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 142/299] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:39 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:40.053325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-121dacff-c951-4f62-a49c-f010d47977b1 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22f4855d-0590-4e21-95ea-9e5051eef432", "device": "/dev/sdb"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:40.056239 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-121dacff-c951-4f62-a49c-f010d47977b1 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:40.066620 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-121dacff-c951-4f62-a49c-f010d47977b1 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:40.067062 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-121dacff-c951-4f62-a49c-f010d47977b1 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:40.068239 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-121dacff-c951-4f62-a49c-f010d47977b1 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:40.068977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-121dacff-c951-4f62-a49c-f010d47977b1 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:40.069433 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f20ece76-9e87-47f8-b951-efe3746684a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:40.078209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f20ece76-9e87-47f8-b951-efe3746684a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.282897 Jun 30 04:17:40.079622 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 158/300] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:39 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:40.495762 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-121dacff-c951-4f62-a49c-f010d47977b1 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "POST /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449362 Jun 30 04:17:40.511450 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 143/301] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:17:40 2022] POST /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:17:40.898174 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e8a09f37-31a4-4178-8864-06217a42e733 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:40.898925 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e8a09f37-31a4-4178-8864-06217a42e733 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:40.906939 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e8a09f37-31a4-4178-8864-06217a42e733 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:40.907965 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e8a09f37-31a4-4178-8864-06217a42e733 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:40.909468 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e8a09f37-31a4-4178-8864-06217a42e733 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:40.910332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e8a09f37-31a4-4178-8864-06217a42e733 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:41.098619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-aafcb147-6221-4965-8ed0-b5b54bf6e8a6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:41.099329 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-aafcb147-6221-4965-8ed0-b5b54bf6e8a6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:41.117610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aafcb147-6221-4965-8ed0-b5b54bf6e8a6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:41.118576 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aafcb147-6221-4965-8ed0-b5b54bf6e8a6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:41.119453 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aafcb147-6221-4965-8ed0-b5b54bf6e8a6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:41.119869 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aafcb147-6221-4965-8ed0-b5b54bf6e8a6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:41.237214 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e8a09f37-31a4-4178-8864-06217a42e733 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:41.248836 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e8a09f37-31a4-4178-8864-06217a42e733 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:41.251149 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e8a09f37-31a4-4178-8864-06217a42e733 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:41.252564 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e8a09f37-31a4-4178-8864-06217a42e733 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1751 microversion: 2.20 time: 0.358319 Jun 30 04:17:41.253818 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 159/302] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:40 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1751 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:41.393679 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-aafcb147-6221-4965-8ed0-b5b54bf6e8a6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:41.425024 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-aafcb147-6221-4965-8ed0-b5b54bf6e8a6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.332383 Jun 30 04:17:41.427311 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 144/303] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:41 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:17:42.271884 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8f33756e-a1ab-437c-8917-d92b38e1a86e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:42.272493 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8f33756e-a1ab-437c-8917-d92b38e1a86e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:42.279458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f33756e-a1ab-437c-8917-d92b38e1a86e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:42.279784 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f33756e-a1ab-437c-8917-d92b38e1a86e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:42.280661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f33756e-a1ab-437c-8917-d92b38e1a86e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:42.281295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f33756e-a1ab-437c-8917-d92b38e1a86e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:42.443885 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8f33756e-a1ab-437c-8917-d92b38e1a86e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:42.444285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b386a5ec-90be-4435-bf0c-38c66e109a33 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:42.445145 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b386a5ec-90be-4435-bf0c-38c66e109a33 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:42.454648 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8f33756e-a1ab-437c-8917-d92b38e1a86e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:42.457019 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8f33756e-a1ab-437c-8917-d92b38e1a86e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:42.458507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8f33756e-a1ab-437c-8917-d92b38e1a86e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1753 microversion: 2.20 time: 0.190683 Jun 30 04:17:42.459701 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 160/304] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:42 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:42.463919 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b386a5ec-90be-4435-bf0c-38c66e109a33 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:42.469337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b386a5ec-90be-4435-bf0c-38c66e109a33 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:42.470468 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b386a5ec-90be-4435-bf0c-38c66e109a33 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:42.471257 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b386a5ec-90be-4435-bf0c-38c66e109a33 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:42.646448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b386a5ec-90be-4435-bf0c-38c66e109a33 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:42.656171 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b386a5ec-90be-4435-bf0c-38c66e109a33 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.216886 Jun 30 04:17:42.657070 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 145/305] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:42 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:43.479314 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0b1d0ff0-1a90-49ef-a362-3c41d2f5b66a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:43.480926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0b1d0ff0-1a90-49ef-a362-3c41d2f5b66a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:43.489808 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0b1d0ff0-1a90-49ef-a362-3c41d2f5b66a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:43.494840 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0b1d0ff0-1a90-49ef-a362-3c41d2f5b66a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:43.495933 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0b1d0ff0-1a90-49ef-a362-3c41d2f5b66a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:43.496568 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0b1d0ff0-1a90-49ef-a362-3c41d2f5b66a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:43.674105 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-24959129-3ead-4f56-90c3-424f8272c836 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:43.674719 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-24959129-3ead-4f56-90c3-424f8272c836 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:43.681463 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24959129-3ead-4f56-90c3-424f8272c836 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:43.681910 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24959129-3ead-4f56-90c3-424f8272c836 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:43.682681 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24959129-3ead-4f56-90c3-424f8272c836 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:43.683143 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24959129-3ead-4f56-90c3-424f8272c836 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:43.685252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0b1d0ff0-1a90-49ef-a362-3c41d2f5b66a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:43.695488 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0b1d0ff0-1a90-49ef-a362-3c41d2f5b66a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:43.697577 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0b1d0ff0-1a90-49ef-a362-3c41d2f5b66a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:43.701949 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0b1d0ff0-1a90-49ef-a362-3c41d2f5b66a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1753 microversion: 2.20 time: 0.227011 Jun 30 04:17:43.702637 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 161/306] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:43 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:43.904714 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-24959129-3ead-4f56-90c3-424f8272c836 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:43.919371 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-24959129-3ead-4f56-90c3-424f8272c836 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.248747 Jun 30 04:17:43.920096 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 146/307] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:43 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:44.720361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f9d8f61e-2e41-47a2-af30-f67c108ba716 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:44.721250 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f9d8f61e-2e41-47a2-af30-f67c108ba716 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:44.723569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=4 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:44.729210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9d8f61e-2e41-47a2-af30-f67c108ba716 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:44.729770 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9d8f61e-2e41-47a2-af30-f67c108ba716 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:44.730600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9d8f61e-2e41-47a2-af30-f67c108ba716 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:44.731126 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9d8f61e-2e41-47a2-af30-f67c108ba716 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:44.937240 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-67589e71-1654-4ae1-b160-aac06b2e3665 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:44.937883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-67589e71-1654-4ae1-b160-aac06b2e3665 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:44.945291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67589e71-1654-4ae1-b160-aac06b2e3665 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:44.945743 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67589e71-1654-4ae1-b160-aac06b2e3665 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:44.946514 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67589e71-1654-4ae1-b160-aac06b2e3665 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:44.947267 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67589e71-1654-4ae1-b160-aac06b2e3665 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:44.969744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f9d8f61e-2e41-47a2-af30-f67c108ba716 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:44.982614 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f9d8f61e-2e41-47a2-af30-f67c108ba716 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:44.984366 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f9d8f61e-2e41-47a2-af30-f67c108ba716 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:44.986099 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f9d8f61e-2e41-47a2-af30-f67c108ba716 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1753 microversion: 2.20 time: 0.269811 Jun 30 04:17:44.987565 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 162/308] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:44 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1753 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:45.185460 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-67589e71-1654-4ae1-b160-aac06b2e3665 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:45.194050 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-67589e71-1654-4ae1-b160-aac06b2e3665 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.260750 Jun 30 04:17:45.195444 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 147/309] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:44 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:17:46.005775 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fe8b8edc-c18e-4668-953f-2c96b2718c38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:46.007647 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fe8b8edc-c18e-4668-953f-2c96b2718c38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:46.020019 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fe8b8edc-c18e-4668-953f-2c96b2718c38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:46.020729 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fe8b8edc-c18e-4668-953f-2c96b2718c38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:46.021502 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fe8b8edc-c18e-4668-953f-2c96b2718c38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:46.022381 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fe8b8edc-c18e-4668-953f-2c96b2718c38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:46.226506 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e5d3bc09-91f1-45fe-9b9e-df61ef7b797d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:46.228712 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e5d3bc09-91f1-45fe-9b9e-df61ef7b797d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:46.231495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fe8b8edc-c18e-4668-953f-2c96b2718c38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:46.244802 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fe8b8edc-c18e-4668-953f-2c96b2718c38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:46.246805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fe8b8edc-c18e-4668-953f-2c96b2718c38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:46.247707 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e5d3bc09-91f1-45fe-9b9e-df61ef7b797d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:46.248457 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fe8b8edc-c18e-4668-953f-2c96b2718c38 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1753 microversion: 2.20 time: 0.246638 Jun 30 04:17:46.249186 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e5d3bc09-91f1-45fe-9b9e-df61ef7b797d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:46.249500 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 163/310] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:45 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1753 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:46.251414 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e5d3bc09-91f1-45fe-9b9e-df61ef7b797d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:46.251938 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e5d3bc09-91f1-45fe-9b9e-df61ef7b797d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:46.487700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e5d3bc09-91f1-45fe-9b9e-df61ef7b797d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:46.499780 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e5d3bc09-91f1-45fe-9b9e-df61ef7b797d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.291419 Jun 30 04:17:46.500449 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 148/311] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:46 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:47.283283 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-01e69a5e-c581-4ddd-a1d2-f14961e01635 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:47.284493 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-01e69a5e-c581-4ddd-a1d2-f14961e01635 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:47.292221 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-01e69a5e-c581-4ddd-a1d2-f14961e01635 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:47.292853 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-01e69a5e-c581-4ddd-a1d2-f14961e01635 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:47.293792 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-01e69a5e-c581-4ddd-a1d2-f14961e01635 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:47.294372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-01e69a5e-c581-4ddd-a1d2-f14961e01635 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:47.519845 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b79ac84f-7e0f-4a29-9c39-1695202ecabf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:47.521200 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b79ac84f-7e0f-4a29-9c39-1695202ecabf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:47.533433 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b79ac84f-7e0f-4a29-9c39-1695202ecabf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:47.539414 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b79ac84f-7e0f-4a29-9c39-1695202ecabf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:47.540554 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b79ac84f-7e0f-4a29-9c39-1695202ecabf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:47.541145 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b79ac84f-7e0f-4a29-9c39-1695202ecabf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:47.585516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-01e69a5e-c581-4ddd-a1d2-f14961e01635 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:47.598893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-01e69a5e-c581-4ddd-a1d2-f14961e01635 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:47.600885 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-01e69a5e-c581-4ddd-a1d2-f14961e01635 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:47.602324 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-01e69a5e-c581-4ddd-a1d2-f14961e01635 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1753 microversion: 2.20 time: 0.325182 Jun 30 04:17:47.603504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 164/312] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:47 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1753 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:47.796035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b79ac84f-7e0f-4a29-9c39-1695202ecabf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:47.813121 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b79ac84f-7e0f-4a29-9c39-1695202ecabf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.299082 Jun 30 04:17:47.820481 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 149/313] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:47 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:48.626882 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b86641e7-6bf8-4eeb-b755-70e9b58c0d57 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:48.628414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b86641e7-6bf8-4eeb-b755-70e9b58c0d57 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:48.640135 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b86641e7-6bf8-4eeb-b755-70e9b58c0d57 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:48.644994 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b86641e7-6bf8-4eeb-b755-70e9b58c0d57 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:48.647885 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b86641e7-6bf8-4eeb-b755-70e9b58c0d57 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:48.648335 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b86641e7-6bf8-4eeb-b755-70e9b58c0d57 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:48.830423 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3ca32cb6-d40d-4b67-9817-e5eeb7335a5f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:48.831036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3ca32cb6-d40d-4b67-9817-e5eeb7335a5f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:48.847703 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ca32cb6-d40d-4b67-9817-e5eeb7335a5f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:48.848301 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ca32cb6-d40d-4b67-9817-e5eeb7335a5f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:48.849141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ca32cb6-d40d-4b67-9817-e5eeb7335a5f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:48.849572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ca32cb6-d40d-4b67-9817-e5eeb7335a5f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:48.886233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:49.032088 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b86641e7-6bf8-4eeb-b755-70e9b58c0d57 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:49.071971 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b86641e7-6bf8-4eeb-b755-70e9b58c0d57 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:49.085791 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b86641e7-6bf8-4eeb-b755-70e9b58c0d57 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:49.087179 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b86641e7-6bf8-4eeb-b755-70e9b58c0d57 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.469543 Jun 30 04:17:49.098477 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 165/314] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:48 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:49.489936 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3ca32cb6-d40d-4b67-9817-e5eeb7335a5f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:49.498708 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3ca32cb6-d40d-4b67-9817-e5eeb7335a5f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.672641 Jun 30 04:17:49.499983 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 150/315] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:48 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:17:50.106292 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cfc6afd9-f50d-415e-96c9-4d5e1b945ff2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:50.106892 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cfc6afd9-f50d-415e-96c9-4d5e1b945ff2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:50.117763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cfc6afd9-f50d-415e-96c9-4d5e1b945ff2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:50.118497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cfc6afd9-f50d-415e-96c9-4d5e1b945ff2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:50.119316 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cfc6afd9-f50d-415e-96c9-4d5e1b945ff2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:50.119781 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cfc6afd9-f50d-415e-96c9-4d5e1b945ff2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:50.308635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cfc6afd9-f50d-415e-96c9-4d5e1b945ff2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:50.309027 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ca17ca01-c483-4cee-9ca1-058a45d4455f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Action: 'create', calling method: .version_select at 0x7fb48030a040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-814051584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlS3io7gYidCibadwv3CgcDjFfvAD6eoMhiyG5jU2KU0zXCh6PbN44AE1zGoj3aPwvg6Z75Rj0FgMrztdqo8wwB95FAmNFwDS73PJqVtQaBSMvpXIpfK4qbO+evxE337A=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:17:50.318140 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cfc6afd9-f50d-415e-96c9-4d5e1b945ff2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:50.319879 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cfc6afd9-f50d-415e-96c9-4d5e1b945ff2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:50.322245 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cfc6afd9-f50d-415e-96c9-4d5e1b945ff2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.218995 Jun 30 04:17:50.322810 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 166/316] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:50 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:50.330831 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-ca17ca01-c483-4cee-9ca1-058a45d4455f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Getting quotas for project c2fe0f4b2519494ea784cea098da6be3. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:17:50.336165 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-ca17ca01-c483-4cee-9ca1-058a45d4455f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Getting quotas for user e269c6a656ff4721911ae25657eeedca and project c2fe0f4b2519494ea784cea098da6be3. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:17:50.374377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ca17ca01-c483-4cee-9ca1-058a45d4455f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.271130 Jun 30 04:17:50.374981 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 151/317] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 30 04:17:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:17:50.517275 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-809b1daa-bf52-46fa-9b6c-77cc9dc3d95a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:50.520328 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-809b1daa-bf52-46fa-9b6c-77cc9dc3d95a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:50.536114 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-809b1daa-bf52-46fa-9b6c-77cc9dc3d95a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:50.537201 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-809b1daa-bf52-46fa-9b6c-77cc9dc3d95a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:50.539908 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-809b1daa-bf52-46fa-9b6c-77cc9dc3d95a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:50.541226 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-809b1daa-bf52-46fa-9b6c-77cc9dc3d95a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:50.792466 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-809b1daa-bf52-46fa-9b6c-77cc9dc3d95a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:50.798453 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:17:50.805123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-809b1daa-bf52-46fa-9b6c-77cc9dc3d95a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.291875 Jun 30 04:17:50.805722 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 167/318] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:50 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:51.345163 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a86a5e33-32a1-4678-9ef9-7235718983f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:51.346088 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a86a5e33-32a1-4678-9ef9-7235718983f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:51.363055 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a86a5e33-32a1-4678-9ef9-7235718983f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:51.363642 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a86a5e33-32a1-4678-9ef9-7235718983f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:51.364512 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a86a5e33-32a1-4678-9ef9-7235718983f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:51.365012 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a86a5e33-32a1-4678-9ef9-7235718983f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:51.573864 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a86a5e33-32a1-4678-9ef9-7235718983f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:51.584595 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a86a5e33-32a1-4678-9ef9-7235718983f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:51.586091 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a86a5e33-32a1-4678-9ef9-7235718983f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:51.587289 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a86a5e33-32a1-4678-9ef9-7235718983f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.250494 Jun 30 04:17:51.588387 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 152/319] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:51 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:51.822280 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-48afd12b-1527-452d-a85a-122661dd04e5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:51.822796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-48afd12b-1527-452d-a85a-122661dd04e5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:51.829969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-48afd12b-1527-452d-a85a-122661dd04e5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:51.830393 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-48afd12b-1527-452d-a85a-122661dd04e5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:51.831211 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-48afd12b-1527-452d-a85a-122661dd04e5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:51.831650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-48afd12b-1527-452d-a85a-122661dd04e5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:51.984642 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-48afd12b-1527-452d-a85a-122661dd04e5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:51.992369 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-48afd12b-1527-452d-a85a-122661dd04e5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.174049 Jun 30 04:17:51.993153 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 168/320] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:51 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:52.606251 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f04c7c16-16bd-4fce-8eec-d226b6471ef7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:52.607122 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f04c7c16-16bd-4fce-8eec-d226b6471ef7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:52.623325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f04c7c16-16bd-4fce-8eec-d226b6471ef7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:52.625436 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f04c7c16-16bd-4fce-8eec-d226b6471ef7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:52.629138 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f04c7c16-16bd-4fce-8eec-d226b6471ef7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:52.629579 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f04c7c16-16bd-4fce-8eec-d226b6471ef7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:52.830516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f04c7c16-16bd-4fce-8eec-d226b6471ef7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:52.841711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f04c7c16-16bd-4fce-8eec-d226b6471ef7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:52.859553 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f04c7c16-16bd-4fce-8eec-d226b6471ef7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:52.865496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f04c7c16-16bd-4fce-8eec-d226b6471ef7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.263420 Jun 30 04:17:52.866687 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 153/321] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:52 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:53.013231 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ff63bd6f-c3bc-4b0b-887f-ed71690a68d0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:53.013835 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ff63bd6f-c3bc-4b0b-887f-ed71690a68d0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:53.028160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff63bd6f-c3bc-4b0b-887f-ed71690a68d0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:53.028609 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff63bd6f-c3bc-4b0b-887f-ed71690a68d0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:53.029438 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff63bd6f-c3bc-4b0b-887f-ed71690a68d0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:53.029918 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff63bd6f-c3bc-4b0b-887f-ed71690a68d0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:53.230090 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ff63bd6f-c3bc-4b0b-887f-ed71690a68d0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:53.239623 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ff63bd6f-c3bc-4b0b-887f-ed71690a68d0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.230737 Jun 30 04:17:53.240933 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 169/322] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:53 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:53.884651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-68720f7c-9cb7-4ac4-ba87-9499ac152458 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:53.886893 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-68720f7c-9cb7-4ac4-ba87-9499ac152458 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:53.901805 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-68720f7c-9cb7-4ac4-ba87-9499ac152458 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:53.902510 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-68720f7c-9cb7-4ac4-ba87-9499ac152458 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:53.903516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-68720f7c-9cb7-4ac4-ba87-9499ac152458 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:53.904097 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-68720f7c-9cb7-4ac4-ba87-9499ac152458 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:54.127776 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-68720f7c-9cb7-4ac4-ba87-9499ac152458 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:54.142313 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-68720f7c-9cb7-4ac4-ba87-9499ac152458 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:54.146208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-68720f7c-9cb7-4ac4-ba87-9499ac152458 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:54.148548 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-68720f7c-9cb7-4ac4-ba87-9499ac152458 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.268088 Jun 30 04:17:54.152310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 154/323] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:53 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:54.256364 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-42b60450-7cce-4038-925f-da65a7f22ab2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:54.257007 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-42b60450-7cce-4038-925f-da65a7f22ab2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:54.275590 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-42b60450-7cce-4038-925f-da65a7f22ab2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:54.276167 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-42b60450-7cce-4038-925f-da65a7f22ab2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:54.277001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-42b60450-7cce-4038-925f-da65a7f22ab2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:54.277411 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-42b60450-7cce-4038-925f-da65a7f22ab2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:54.513460 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-42b60450-7cce-4038-925f-da65a7f22ab2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:54.521681 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-42b60450-7cce-4038-925f-da65a7f22ab2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.269096 Jun 30 04:17:54.527164 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 170/324] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:54 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:55.170282 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d1a7097f-8199-4b7a-bc65-53d366c36ed1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:55.170911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d1a7097f-8199-4b7a-bc65-53d366c36ed1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:55.186058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d1a7097f-8199-4b7a-bc65-53d366c36ed1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:55.186510 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d1a7097f-8199-4b7a-bc65-53d366c36ed1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:55.187329 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d1a7097f-8199-4b7a-bc65-53d366c36ed1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:55.187782 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d1a7097f-8199-4b7a-bc65-53d366c36ed1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:55.375084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d1a7097f-8199-4b7a-bc65-53d366c36ed1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:55.385246 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d1a7097f-8199-4b7a-bc65-53d366c36ed1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:55.386748 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d1a7097f-8199-4b7a-bc65-53d366c36ed1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:55.387973 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d1a7097f-8199-4b7a-bc65-53d366c36ed1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.222020 Jun 30 04:17:55.388530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 155/325] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:55 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:55.539557 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1869981a-88ec-44e0-9747-023730701515 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:55.540184 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1869981a-88ec-44e0-9747-023730701515 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:55.546838 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1869981a-88ec-44e0-9747-023730701515 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:55.547324 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1869981a-88ec-44e0-9747-023730701515 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:55.548063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1869981a-88ec-44e0-9747-023730701515 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:55.548940 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1869981a-88ec-44e0-9747-023730701515 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:55.691900 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1869981a-88ec-44e0-9747-023730701515 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:55.699855 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1869981a-88ec-44e0-9747-023730701515 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.164391 Jun 30 04:17:55.700451 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 171/326] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:55 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:56.406385 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f2184754-b4ea-4854-a8d4-cb90a49b834e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:56.407393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f2184754-b4ea-4854-a8d4-cb90a49b834e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:56.414913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2184754-b4ea-4854-a8d4-cb90a49b834e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:56.415393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2184754-b4ea-4854-a8d4-cb90a49b834e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:56.416156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2184754-b4ea-4854-a8d4-cb90a49b834e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:56.416576 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2184754-b4ea-4854-a8d4-cb90a49b834e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:56.553101 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f2184754-b4ea-4854-a8d4-cb90a49b834e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:56.566603 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f2184754-b4ea-4854-a8d4-cb90a49b834e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:56.568969 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f2184754-b4ea-4854-a8d4-cb90a49b834e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:56.570657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f2184754-b4ea-4854-a8d4-cb90a49b834e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.168178 Jun 30 04:17:56.571499 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 156/327] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:56 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:56.717504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cf86d3e4-62e2-4a75-98c4-b7d6a8e20e45 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:56.719240 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cf86d3e4-62e2-4a75-98c4-b7d6a8e20e45 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:56.725860 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf86d3e4-62e2-4a75-98c4-b7d6a8e20e45 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:56.727214 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf86d3e4-62e2-4a75-98c4-b7d6a8e20e45 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:56.728234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf86d3e4-62e2-4a75-98c4-b7d6a8e20e45 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:56.728928 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf86d3e4-62e2-4a75-98c4-b7d6a8e20e45 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:56.883668 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cf86d3e4-62e2-4a75-98c4-b7d6a8e20e45 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:56.891411 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cf86d3e4-62e2-4a75-98c4-b7d6a8e20e45 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.177725 Jun 30 04:17:56.891982 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 172/328] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:56 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:57.594346 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a8ddc64c-a631-481e-9721-1815e0d0575b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:57.595390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a8ddc64c-a631-481e-9721-1815e0d0575b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:57.602538 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a8ddc64c-a631-481e-9721-1815e0d0575b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:57.603270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a8ddc64c-a631-481e-9721-1815e0d0575b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:57.604231 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a8ddc64c-a631-481e-9721-1815e0d0575b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:57.604836 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a8ddc64c-a631-481e-9721-1815e0d0575b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:57.792812 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a8ddc64c-a631-481e-9721-1815e0d0575b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:57.802089 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a8ddc64c-a631-481e-9721-1815e0d0575b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:57.803606 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a8ddc64c-a631-481e-9721-1815e0d0575b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:57.814958 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a8ddc64c-a631-481e-9721-1815e0d0575b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.215259 Jun 30 04:17:57.815688 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 157/329] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:57 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:57.910539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6714441f-3603-4ebc-964e-fcb096b48b58 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:57.912033 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6714441f-3603-4ebc-964e-fcb096b48b58 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:57.927515 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6714441f-3603-4ebc-964e-fcb096b48b58 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:57.928325 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6714441f-3603-4ebc-964e-fcb096b48b58 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:57.931400 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6714441f-3603-4ebc-964e-fcb096b48b58 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:57.931943 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6714441f-3603-4ebc-964e-fcb096b48b58 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:58.089756 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6714441f-3603-4ebc-964e-fcb096b48b58 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:58.098073 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6714441f-3603-4ebc-964e-fcb096b48b58 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.192164 Jun 30 04:17:58.098661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 173/330] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:57 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:17:58.833320 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7e76f1c1-febf-4f66-93af-253eabd45095 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:58.833958 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7e76f1c1-febf-4f66-93af-253eabd45095 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:58.841319 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7e76f1c1-febf-4f66-93af-253eabd45095 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:58.841756 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7e76f1c1-febf-4f66-93af-253eabd45095 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:58.842509 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7e76f1c1-febf-4f66-93af-253eabd45095 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:58.842965 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7e76f1c1-febf-4f66-93af-253eabd45095 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:58.994282 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7e76f1c1-febf-4f66-93af-253eabd45095 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:59.004322 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7e76f1c1-febf-4f66-93af-253eabd45095 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:59.005526 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7e76f1c1-febf-4f66-93af-253eabd45095 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:59.006881 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7e76f1c1-febf-4f66-93af-253eabd45095 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.177748 Jun 30 04:17:59.007692 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 158/331] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:17:58 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:17:59.115454 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1e900c16-9706-40f7-92bb-dab5cd49e96a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:17:59.116215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1e900c16-9706-40f7-92bb-dab5cd49e96a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:17:59.122228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1e900c16-9706-40f7-92bb-dab5cd49e96a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:59.122673 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1e900c16-9706-40f7-92bb-dab5cd49e96a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:59.123463 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1e900c16-9706-40f7-92bb-dab5cd49e96a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:17:59.123900 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1e900c16-9706-40f7-92bb-dab5cd49e96a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:17:59.300409 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1e900c16-9706-40f7-92bb-dab5cd49e96a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:17:59.309552 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1e900c16-9706-40f7-92bb-dab5cd49e96a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.198366 Jun 30 04:17:59.310490 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 174/332] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:17:59 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:00.026173 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dd9a7767-28b8-45ad-8a87-c7131634c4d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:00.026802 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dd9a7767-28b8-45ad-8a87-c7131634c4d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:00.033885 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd9a7767-28b8-45ad-8a87-c7131634c4d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:00.034305 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd9a7767-28b8-45ad-8a87-c7131634c4d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:00.035110 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd9a7767-28b8-45ad-8a87-c7131634c4d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:00.035575 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd9a7767-28b8-45ad-8a87-c7131634c4d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:00.190154 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dd9a7767-28b8-45ad-8a87-c7131634c4d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:00.199197 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dd9a7767-28b8-45ad-8a87-c7131634c4d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:00.200958 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dd9a7767-28b8-45ad-8a87-c7131634c4d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:00.202177 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dd9a7767-28b8-45ad-8a87-c7131634c4d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.180104 Jun 30 04:18:00.202748 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 159/333] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:00 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:00.331750 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d6b90749-37d9-4718-87c0-caa812895f3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:00.332809 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d6b90749-37d9-4718-87c0-caa812895f3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:00.336797 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:00.341273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d6b90749-37d9-4718-87c0-caa812895f3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:00.341806 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d6b90749-37d9-4718-87c0-caa812895f3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:00.342584 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d6b90749-37d9-4718-87c0-caa812895f3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:00.343018 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d6b90749-37d9-4718-87c0-caa812895f3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:00.490445 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d6b90749-37d9-4718-87c0-caa812895f3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:00.498197 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d6b90749-37d9-4718-87c0-caa812895f3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.173301 Jun 30 04:18:00.498758 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 175/334] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:00 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:01.221149 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f5666e19-b0ae-4d9b-b7d5-d25eac235ac2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:01.222458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f5666e19-b0ae-4d9b-b7d5-d25eac235ac2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:01.225697 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=4 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:01.230301 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5666e19-b0ae-4d9b-b7d5-d25eac235ac2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:01.230735 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5666e19-b0ae-4d9b-b7d5-d25eac235ac2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:01.231698 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5666e19-b0ae-4d9b-b7d5-d25eac235ac2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:01.232287 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5666e19-b0ae-4d9b-b7d5-d25eac235ac2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:01.389307 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f5666e19-b0ae-4d9b-b7d5-d25eac235ac2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:01.398196 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f5666e19-b0ae-4d9b-b7d5-d25eac235ac2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:01.399892 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f5666e19-b0ae-4d9b-b7d5-d25eac235ac2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:01.401083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f5666e19-b0ae-4d9b-b7d5-d25eac235ac2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.184269 Jun 30 04:18:01.401654 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 160/335] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:01 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:01.518246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-971c1f6d-47a5-46be-9d95-fc8318490473 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:01.518888 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-971c1f6d-47a5-46be-9d95-fc8318490473 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:01.529151 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-971c1f6d-47a5-46be-9d95-fc8318490473 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:01.529501 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-971c1f6d-47a5-46be-9d95-fc8318490473 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:01.532717 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-971c1f6d-47a5-46be-9d95-fc8318490473 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:01.533452 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-971c1f6d-47a5-46be-9d95-fc8318490473 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:01.700919 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-971c1f6d-47a5-46be-9d95-fc8318490473 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:01.709658 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-971c1f6d-47a5-46be-9d95-fc8318490473 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.197786 Jun 30 04:18:01.710454 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 176/336] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:01 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:02.420957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1100c6cd-d512-47b1-862b-9dd72b014861 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:02.421695 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1100c6cd-d512-47b1-862b-9dd72b014861 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:02.424576 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:02.430390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1100c6cd-d512-47b1-862b-9dd72b014861 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:02.430821 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1100c6cd-d512-47b1-862b-9dd72b014861 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:02.431614 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1100c6cd-d512-47b1-862b-9dd72b014861 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:02.432036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1100c6cd-d512-47b1-862b-9dd72b014861 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:02.581906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1100c6cd-d512-47b1-862b-9dd72b014861 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:02.591449 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1100c6cd-d512-47b1-862b-9dd72b014861 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:02.592937 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1100c6cd-d512-47b1-862b-9dd72b014861 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:02.594101 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1100c6cd-d512-47b1-862b-9dd72b014861 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.177661 Jun 30 04:18:02.594651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 161/337] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:02 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:18:02.731645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f2cdfdb4-986d-4c8c-9991-fd70a8434e1a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:02.731645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f2cdfdb4-986d-4c8c-9991-fd70a8434e1a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:02.736264 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f2cdfdb4-986d-4c8c-9991-fd70a8434e1a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:02.736797 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f2cdfdb4-986d-4c8c-9991-fd70a8434e1a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:02.737812 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f2cdfdb4-986d-4c8c-9991-fd70a8434e1a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:02.738284 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f2cdfdb4-986d-4c8c-9991-fd70a8434e1a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:02.869566 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f2cdfdb4-986d-4c8c-9991-fd70a8434e1a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:02.877205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f2cdfdb4-986d-4c8c-9991-fd70a8434e1a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.154187 Jun 30 04:18:02.877768 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 177/338] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:02 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:03.612377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-45057f2b-2ce9-43fc-abac-f31f70208b29 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:03.612933 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-45057f2b-2ce9-43fc-abac-f31f70208b29 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:03.620666 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-45057f2b-2ce9-43fc-abac-f31f70208b29 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:03.621117 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-45057f2b-2ce9-43fc-abac-f31f70208b29 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:03.621894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-45057f2b-2ce9-43fc-abac-f31f70208b29 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:03.622325 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-45057f2b-2ce9-43fc-abac-f31f70208b29 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:03.761390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-45057f2b-2ce9-43fc-abac-f31f70208b29 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:03.771282 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-45057f2b-2ce9-43fc-abac-f31f70208b29 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:03.772791 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-45057f2b-2ce9-43fc-abac-f31f70208b29 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:03.774053 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-45057f2b-2ce9-43fc-abac-f31f70208b29 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.165684 Jun 30 04:18:03.774586 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 162/339] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:03 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:03.894704 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-467d3e9f-50d5-4086-a766-ca53804a3853 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:03.895336 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-467d3e9f-50d5-4086-a766-ca53804a3853 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:03.902390 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-467d3e9f-50d5-4086-a766-ca53804a3853 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:03.902828 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-467d3e9f-50d5-4086-a766-ca53804a3853 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:03.903618 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-467d3e9f-50d5-4086-a766-ca53804a3853 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:03.904041 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-467d3e9f-50d5-4086-a766-ca53804a3853 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:04.047888 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-467d3e9f-50d5-4086-a766-ca53804a3853 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:04.057804 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-467d3e9f-50d5-4086-a766-ca53804a3853 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.167232 Jun 30 04:18:04.058370 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 178/340] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:03 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:04.793450 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4be02b15-f069-4bb2-9130-e00fd9e468f3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:04.794016 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4be02b15-f069-4bb2-9130-e00fd9e468f3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:04.801012 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4be02b15-f069-4bb2-9130-e00fd9e468f3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:04.801427 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4be02b15-f069-4bb2-9130-e00fd9e468f3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:04.802472 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4be02b15-f069-4bb2-9130-e00fd9e468f3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:04.802909 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4be02b15-f069-4bb2-9130-e00fd9e468f3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:04.869824 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-736b7ca6-9ed6-423b-8f6a-4248104922cd tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:04.870337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-736b7ca6-9ed6-423b-8f6a-4248104922cd tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:04.879481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-736b7ca6-9ed6-423b-8f6a-4248104922cd tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:04.879927 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-736b7ca6-9ed6-423b-8f6a-4248104922cd tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:04.880684 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-736b7ca6-9ed6-423b-8f6a-4248104922cd tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:04.881343 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-736b7ca6-9ed6-423b-8f6a-4248104922cd tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:05.006146 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4be02b15-f069-4bb2-9130-e00fd9e468f3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:05.014306 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4be02b15-f069-4bb2-9130-e00fd9e468f3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:05.015888 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4be02b15-f069-4bb2-9130-e00fd9e468f3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:05.017088 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4be02b15-f069-4bb2-9130-e00fd9e468f3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.227804 Jun 30 04:18:05.017614 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 163/341] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:04 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:05.019635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-736b7ca6-9ed6-423b-8f6a-4248104922cd tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lazy-loading 'services' on Instance uuid e6a5fa82-8302-40a4-bdd8-f8ee19570259 {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:18:05.076193 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bc91b555-4a03-46f7-9830-70504358d2cd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:05.076792 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bc91b555-4a03-46f7-9830-70504358d2cd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:05.083250 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc91b555-4a03-46f7-9830-70504358d2cd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:05.083704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc91b555-4a03-46f7-9830-70504358d2cd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:05.084506 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc91b555-4a03-46f7-9830-70504358d2cd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:05.084948 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc91b555-4a03-46f7-9830-70504358d2cd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:05.149518 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-736b7ca6-9ed6-423b-8f6a-4248104922cd tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259/os-volume_attachments/22f4855d-0590-4e21-95ea-9e5051eef432" status: 202 len: 0 microversion: 2.1 time: 0.284998 Jun 30 04:18:05.152440 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 179/342] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:18:04 2022] DELETE /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259/os-volume_attachments/22f4855d-0590-4e21-95ea-9e5051eef432 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 04:18:05.229224 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bc91b555-4a03-46f7-9830-70504358d2cd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:05.237202 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bc91b555-4a03-46f7-9830-70504358d2cd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.164909 Jun 30 04:18:05.237957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 164/343] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:05 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:06.036617 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c03ef7b0-99b6-4f25-a87b-22e27f039769 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:06.037323 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c03ef7b0-99b6-4f25-a87b-22e27f039769 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:06.047379 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c03ef7b0-99b6-4f25-a87b-22e27f039769 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:06.047815 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c03ef7b0-99b6-4f25-a87b-22e27f039769 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:06.048576 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c03ef7b0-99b6-4f25-a87b-22e27f039769 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:06.048997 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c03ef7b0-99b6-4f25-a87b-22e27f039769 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:06.207028 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c03ef7b0-99b6-4f25-a87b-22e27f039769 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:06.215575 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c03ef7b0-99b6-4f25-a87b-22e27f039769 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:06.217291 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c03ef7b0-99b6-4f25-a87b-22e27f039769 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:06.218195 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c03ef7b0-99b6-4f25-a87b-22e27f039769 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.187059 Jun 30 04:18:06.218750 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 180/344] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:06 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:06.253914 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5e11a44e-d330-4beb-b621-52433ec84d91 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:06.254524 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5e11a44e-d330-4beb-b621-52433ec84d91 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:06.271189 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e11a44e-d330-4beb-b621-52433ec84d91 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:06.271189 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e11a44e-d330-4beb-b621-52433ec84d91 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:06.271189 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e11a44e-d330-4beb-b621-52433ec84d91 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:06.271189 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e11a44e-d330-4beb-b621-52433ec84d91 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:06.413224 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5e11a44e-d330-4beb-b621-52433ec84d91 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:06.421433 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5e11a44e-d330-4beb-b621-52433ec84d91 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1521 microversion: 2.1 time: 0.171494 Jun 30 04:18:06.422008 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 165/345] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:06 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:07.236943 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b98f9ad1-833d-430c-b24e-e887ca8a2ce9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:07.237503 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b98f9ad1-833d-430c-b24e-e887ca8a2ce9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:07.243701 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b98f9ad1-833d-430c-b24e-e887ca8a2ce9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:07.244169 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b98f9ad1-833d-430c-b24e-e887ca8a2ce9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:07.245127 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b98f9ad1-833d-430c-b24e-e887ca8a2ce9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:07.245551 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b98f9ad1-833d-430c-b24e-e887ca8a2ce9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:07.331919 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e3c00ae0-5c1e-4ce7-894f-f284cd4f6e4e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:07.332499 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e3c00ae0-5c1e-4ce7-894f-f284cd4f6e4e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:07.339264 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e3c00ae0-5c1e-4ce7-894f-f284cd4f6e4e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:07.339994 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e3c00ae0-5c1e-4ce7-894f-f284cd4f6e4e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:07.340953 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e3c00ae0-5c1e-4ce7-894f-f284cd4f6e4e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:07.341540 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e3c00ae0-5c1e-4ce7-894f-f284cd4f6e4e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:07.394712 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b98f9ad1-833d-430c-b24e-e887ca8a2ce9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:07.403302 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e3c00ae0-5c1e-4ce7-894f-f284cd4f6e4e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:18:07.405980 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b98f9ad1-833d-430c-b24e-e887ca8a2ce9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:07.408890 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b98f9ad1-833d-430c-b24e-e887ca8a2ce9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:07.410047 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b98f9ad1-833d-430c-b24e-e887ca8a2ce9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.177224 Jun 30 04:18:07.422507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 181/346] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:07 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:07.441463 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-313e083b-4341-4f41-b99a-fb4f365739b5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:07.442385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-313e083b-4341-4f41-b99a-fb4f365739b5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:07.451129 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-313e083b-4341-4f41-b99a-fb4f365739b5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:07.451671 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-313e083b-4341-4f41-b99a-fb4f365739b5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:07.452366 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-313e083b-4341-4f41-b99a-fb4f365739b5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:07.453373 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-313e083b-4341-4f41-b99a-fb4f365739b5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:07.463215 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:07.516653 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e3c00ae0-5c1e-4ce7-894f-f284cd4f6e4e tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 204 len: 0 microversion: 2.1 time: 0.188276 Jun 30 04:18:07.520810 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 166/347] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:18:07 2022] DELETE /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 04:18:07.528252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d7ea2048-d70b-48a5-9227-9eb3832724e6 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:07.529801 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d7ea2048-d70b-48a5-9227-9eb3832724e6 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:07.539535 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7ea2048-d70b-48a5-9227-9eb3832724e6 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:07.540050 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7ea2048-d70b-48a5-9227-9eb3832724e6 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:07.540910 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7ea2048-d70b-48a5-9227-9eb3832724e6 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:07.541407 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7ea2048-d70b-48a5-9227-9eb3832724e6 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:07.657747 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-313e083b-4341-4f41-b99a-fb4f365739b5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:07.666585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-313e083b-4341-4f41-b99a-fb4f365739b5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1501 microversion: 2.1 time: 0.231119 Jun 30 04:18:07.667177 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 182/348] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:07 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1501 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:07.682750 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-678cc57c-4b24-4e67-9001-63dd198fee15 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:07.683498 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-678cc57c-4b24-4e67-9001-63dd198fee15 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:07.690050 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-678cc57c-4b24-4e67-9001-63dd198fee15 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:07.690455 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-678cc57c-4b24-4e67-9001-63dd198fee15 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:07.696005 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-678cc57c-4b24-4e67-9001-63dd198fee15 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:07.696767 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-678cc57c-4b24-4e67-9001-63dd198fee15 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:07.707081 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d7ea2048-d70b-48a5-9227-9eb3832724e6 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:07.715319 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d7ea2048-d70b-48a5-9227-9eb3832724e6 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1512 microversion: 2.1 time: 0.192423 Jun 30 04:18:07.716229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 167/349] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:07 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:07.855234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-678cc57c-4b24-4e67-9001-63dd198fee15 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:07.860366 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:07.867197 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-678cc57c-4b24-4e67-9001-63dd198fee15 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1515 microversion: 2.1 time: 0.187930 Jun 30 04:18:07.867736 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 183/350] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:07 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:08.433991 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6a663d88-f118-44ba-8491-ef77e1d31cb6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:08.435190 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6a663d88-f118-44ba-8491-ef77e1d31cb6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:08.443950 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a663d88-f118-44ba-8491-ef77e1d31cb6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:08.444393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a663d88-f118-44ba-8491-ef77e1d31cb6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:08.445199 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a663d88-f118-44ba-8491-ef77e1d31cb6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:08.445601 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a663d88-f118-44ba-8491-ef77e1d31cb6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:08.591594 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6a663d88-f118-44ba-8491-ef77e1d31cb6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:08.600290 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6a663d88-f118-44ba-8491-ef77e1d31cb6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:08.601819 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6a663d88-f118-44ba-8491-ef77e1d31cb6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:08.603173 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6a663d88-f118-44ba-8491-ef77e1d31cb6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.174338 Jun 30 04:18:08.603749 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 168/351] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:08 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:08.733386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-06017d94-671e-4151-b8d1-c529fda834d5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:08.733893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-06017d94-671e-4151-b8d1-c529fda834d5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:08.741024 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06017d94-671e-4151-b8d1-c529fda834d5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:08.741458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06017d94-671e-4151-b8d1-c529fda834d5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:08.742242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06017d94-671e-4151-b8d1-c529fda834d5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:08.742670 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06017d94-671e-4151-b8d1-c529fda834d5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:08.884188 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-06017d94-671e-4151-b8d1-c529fda834d5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:08.892280 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-06017d94-671e-4151-b8d1-c529fda834d5 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1512 microversion: 2.1 time: 0.162973 Jun 30 04:18:08.892973 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 184/352] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:08 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:09.250921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fa399240-c6b2-43ed-8c2e-54f9454f7702 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:09.252094 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fa399240-c6b2-43ed-8c2e-54f9454f7702 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:09.258547 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa399240-c6b2-43ed-8c2e-54f9454f7702 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:09.258994 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa399240-c6b2-43ed-8c2e-54f9454f7702 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:09.259775 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa399240-c6b2-43ed-8c2e-54f9454f7702 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:09.260205 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa399240-c6b2-43ed-8c2e-54f9454f7702 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:09.284794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-fa399240-c6b2-43ed-8c2e-54f9454f7702 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lazy-loading 'flavor' on Instance uuid b9a789ea-78f4-481d-bd9b-45bce25676ad {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:18:09.402441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fa399240-c6b2-43ed-8c2e-54f9454f7702 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad/action" status: 200 len: 32 microversion: 2.1 time: 0.155529 Jun 30 04:18:09.403050 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 169/353] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:18:09 2022] POST /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 04:18:09.412538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f9cc88ff-d4cb-4e04-9f4b-8c744d61e7ed tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:09.413187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f9cc88ff-d4cb-4e04-9f4b-8c744d61e7ed tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:09.419507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9cc88ff-d4cb-4e04-9f4b-8c744d61e7ed tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:09.419952 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9cc88ff-d4cb-4e04-9f4b-8c744d61e7ed tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:09.420707 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9cc88ff-d4cb-4e04-9f4b-8c744d61e7ed tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:09.421132 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9cc88ff-d4cb-4e04-9f4b-8c744d61e7ed tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:09.576072 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f9cc88ff-d4cb-4e04-9f4b-8c744d61e7ed tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:09.584966 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f9cc88ff-d4cb-4e04-9f4b-8c744d61e7ed tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.176390 Jun 30 04:18:09.585547 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 185/354] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:09 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:09.622204 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8726f63c-2c44-43cc-8b6b-6de0f1c50c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:09.622897 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8726f63c-2c44-43cc-8b6b-6de0f1c50c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:09.630190 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8726f63c-2c44-43cc-8b6b-6de0f1c50c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:09.630634 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8726f63c-2c44-43cc-8b6b-6de0f1c50c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:09.631433 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8726f63c-2c44-43cc-8b6b-6de0f1c50c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:09.631865 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8726f63c-2c44-43cc-8b6b-6de0f1c50c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:09.764782 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8726f63c-2c44-43cc-8b6b-6de0f1c50c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:09.773843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8726f63c-2c44-43cc-8b6b-6de0f1c50c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:09.775614 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8726f63c-2c44-43cc-8b6b-6de0f1c50c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:09.776784 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8726f63c-2c44-43cc-8b6b-6de0f1c50c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.160070 Jun 30 04:18:09.777347 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 170/355] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:09 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:09.914354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-491b3d78-12b6-43a6-bde4-c95d1e2c8aba tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:09.915130 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-491b3d78-12b6-43a6-bde4-c95d1e2c8aba tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:09.924918 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-491b3d78-12b6-43a6-bde4-c95d1e2c8aba tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:09.925607 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-491b3d78-12b6-43a6-bde4-c95d1e2c8aba tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:09.926817 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-491b3d78-12b6-43a6-bde4-c95d1e2c8aba tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:09.927566 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-491b3d78-12b6-43a6-bde4-c95d1e2c8aba tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:10.062297 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-491b3d78-12b6-43a6-bde4-c95d1e2c8aba tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:10.071021 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-491b3d78-12b6-43a6-bde4-c95d1e2c8aba tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1512 microversion: 2.1 time: 0.163126 Jun 30 04:18:10.071612 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 186/356] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:09 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:10.603836 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-21e6cf2a-a9c8-4a7f-90f8-033da06e3537 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:10.604877 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-21e6cf2a-a9c8-4a7f-90f8-033da06e3537 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:10.612141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21e6cf2a-a9c8-4a7f-90f8-033da06e3537 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:10.612875 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21e6cf2a-a9c8-4a7f-90f8-033da06e3537 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:10.613759 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21e6cf2a-a9c8-4a7f-90f8-033da06e3537 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:10.614277 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21e6cf2a-a9c8-4a7f-90f8-033da06e3537 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:10.796063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-caf7dd5a-a175-4de5-ad85-7cff0cfea552 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:10.796662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-caf7dd5a-a175-4de5-ad85-7cff0cfea552 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:10.803468 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-caf7dd5a-a175-4de5-ad85-7cff0cfea552 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:10.803941 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-caf7dd5a-a175-4de5-ad85-7cff0cfea552 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:10.804747 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-caf7dd5a-a175-4de5-ad85-7cff0cfea552 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:10.805174 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-caf7dd5a-a175-4de5-ad85-7cff0cfea552 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:10.951644 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-21e6cf2a-a9c8-4a7f-90f8-033da06e3537 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:10.961173 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-21e6cf2a-a9c8-4a7f-90f8-033da06e3537 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.362258 Jun 30 04:18:10.961866 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 171/357] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:10 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:11.032936 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-caf7dd5a-a175-4de5-ad85-7cff0cfea552 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:11.043337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-caf7dd5a-a175-4de5-ad85-7cff0cfea552 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:11.045068 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-caf7dd5a-a175-4de5-ad85-7cff0cfea552 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:11.046239 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-caf7dd5a-a175-4de5-ad85-7cff0cfea552 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.254166 Jun 30 04:18:11.046929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 187/358] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:10 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:18:11.092841 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9fd82ce0-a3b8-48b3-95a6-73144baef513 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:11.093653 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9fd82ce0-a3b8-48b3-95a6-73144baef513 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:11.101580 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9fd82ce0-a3b8-48b3-95a6-73144baef513 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:11.102045 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9fd82ce0-a3b8-48b3-95a6-73144baef513 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:11.102814 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9fd82ce0-a3b8-48b3-95a6-73144baef513 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:11.103320 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9fd82ce0-a3b8-48b3-95a6-73144baef513 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:11.412144 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-86642b75-15ea-429d-8d86-ae2e6ed9a6a6 req-e1ce40c5-75cd-41d8-b850-ea41d2515f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a5fa82-8302-40a4-bdd8-f8ee19570259", "name": "network-vif-deleted", "tag": "ff35c296-16d8-4967-9683-da4fed5ad994"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:11.417847 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9fd82ce0-a3b8-48b3-95a6-73144baef513 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:11.422551 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-86642b75-15ea-429d-8d86-ae2e6ed9a6a6 req-e1ce40c5-75cd-41d8-b850-ea41d2515f88 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:11.423835 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-86642b75-15ea-429d-8d86-ae2e6ed9a6a6 req-e1ce40c5-75cd-41d8-b850-ea41d2515f88 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:11.430548 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9fd82ce0-a3b8-48b3-95a6-73144baef513 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 200 len: 1512 microversion: 2.1 time: 0.341179 Jun 30 04:18:11.432322 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 172/359] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:11 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 1512 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:11.458738 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-86642b75-15ea-429d-8d86-ae2e6ed9a6a6 req-e1ce40c5-75cd-41d8-b850-ea41d2515f88 service nova] Creating event network-vif-deleted:ff35c296-16d8-4967-9683-da4fed5ad994 for instance e6a5fa82-8302-40a4-bdd8-f8ee19570259 on hv-cinder-84684 Jun 30 04:18:11.466116 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-86642b75-15ea-429d-8d86-ae2e6ed9a6a6 req-e1ce40c5-75cd-41d8-b850-ea41d2515f88 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057469 Jun 30 04:18:11.466977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 188/360] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:11.685443 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1150952711", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-576365692", "security_groups": [{"name": "tempest-secgroup-smoke-1631971289"}], "networks": [{"uuid": "c7bb47d5-3e98-456a-bf3a-91e07afacb65"}], "block_device_mapping_v2": [{"uuid": "d15c2fe2-063e-460d-87d4-95e4321214c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:11.878216 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] validate_networks() for [('c7bb47d5-3e98-456a-bf3a-91e07afacb65', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:18:11.978753 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fe8f9274-7393-40ec-8c61-33041bfd3daf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:11.979842 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fe8f9274-7393-40ec-8c61-33041bfd3daf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:11.986453 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fe8f9274-7393-40ec-8c61-33041bfd3daf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:11.986964 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fe8f9274-7393-40ec-8c61-33041bfd3daf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:11.987848 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fe8f9274-7393-40ec-8c61-33041bfd3daf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:11.988337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fe8f9274-7393-40ec-8c61-33041bfd3daf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:12.307391 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fe8f9274-7393-40ec-8c61-33041bfd3daf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:12.315183 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fe8f9274-7393-40ec-8c61-33041bfd3daf tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.340699 Jun 30 04:18:12.315747 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 189/361] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:11 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:12.320352 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ad810fed-ebe2-4766-aefe-9568551e7d3a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:12.320940 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ad810fed-ebe2-4766-aefe-9568551e7d3a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:12.326810 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ad810fed-ebe2-4766-aefe-9568551e7d3a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:12.327310 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ad810fed-ebe2-4766-aefe-9568551e7d3a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:12.328057 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ad810fed-ebe2-4766-aefe-9568551e7d3a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:12.328480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ad810fed-ebe2-4766-aefe-9568551e7d3a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:12.638736 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ad810fed-ebe2-4766-aefe-9568551e7d3a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:12.648661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ad810fed-ebe2-4766-aefe-9568551e7d3a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:12.650160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ad810fed-ebe2-4766-aefe-9568551e7d3a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:12.651384 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ad810fed-ebe2-4766-aefe-9568551e7d3a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.334699 Jun 30 04:18:12.652334 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 190/362] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:12 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:12.656894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5644298e-f668-4963-82bf-1f581eda4941 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:12.657508 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5644298e-f668-4963-82bf-1f581eda4941 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: e6a5fa82-8302-40a4-bdd8-f8ee19570259] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:12.663923 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5644298e-f668-4963-82bf-1f581eda4941 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:12.664371 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5644298e-f668-4963-82bf-1f581eda4941 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:12.665142 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5644298e-f668-4963-82bf-1f581eda4941 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:12.665560 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5644298e-f668-4963-82bf-1f581eda4941 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:12.667175 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:18:12.667741 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:18:12.668466 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:18:12.668972 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:18:12.670571 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:18:12.678906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:12.679686 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:12.680445 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-5644298e-f668-4963-82bf-1f581eda4941 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] HTTP exception thrown: Instance e6a5fa82-8302-40a4-bdd8-f8ee19570259 could not be found. Jun 30 04:18:12.680763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:12.681369 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5644298e-f668-4963-82bf-1f581eda4941 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Request method failure captured: Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 HTTP/1.1 Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSObS32u-q54Fms-kyR22_q7uJ0KG8ww8k9WtcK9OWbqkyrYeevH7E6UqQiZNforUpZeOVeS9tGzU_go2KHHmDp0n903YmzLACdqclxxza-ZospPovUPL-2KXNqb0-f8wWwiZe-omIU3znvD5614uhi8wpAESdh5rXl50JdirqiiEI4 Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 4a5e183a36084c9fb82f3a3f7d24402a Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-VolumesSnapshotTestJSON-599944138 Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:18:12.682048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a5e183a36084c9fb82f3a3f7d24402a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a5e183a36084c9fb82f3a3f7d24402a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a5e183a36084c9fb82f3a3f7d24402a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a5e183a36084c9fb82f3a3f7d24402a"}]}] Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-VolumesSnapshotTestJSON-599944138 Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 4a5e183a36084c9fb82f3a3f7d24402a Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-599944138 Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-VolumesSnapshotTestJSON-599944138-project Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: abfd09ef27184291a36b43b6664740c5 Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-VolumesSnapshotTestJSON-599944138-project Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance e6a5fa82-8302-40a4-bdd8-f8ee19570259 could not be found. Jun 30 04:18:12.683653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': 'e6a5fa82-8302-40a4-bdd8-f8ee19570259'} Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6a5fa82-8302-40a4-bdd8-f8ee19570259 could not be found. Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:18:12.684416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6a5fa82-8302-40a4-bdd8-f8ee19570259 could not be found. Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6a5fa82-8302-40a4-bdd8-f8ee19570259 could not be found. Jun 30 04:18:12.685715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:18:12.686858 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5644298e-f668-4963-82bf-1f581eda4941 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Returning 404 to user: Instance e6a5fa82-8302-40a4-bdd8-f8ee19570259 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:18:12.686858 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5644298e-f668-4963-82bf-1f581eda4941 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259" status: 404 len: 111 microversion: 2.1 time: 0.030825 Jun 30 04:18:12.686858 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 191/363] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:12 2022] GET /compute/v2.1/servers/e6a5fa82-8302-40a4-bdd8-f8ee19570259 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:18:12.711239 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Getting quotas for project 62d0dd3cae1448049dc95fb347fd1a80. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:18:12.717597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Getting quotas for user ebfcd2137bf94726a25fea389ef24430 and project 62d0dd3cae1448049dc95fb347fd1a80. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:18:12.785836 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:18:12.789045 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d15c2fe2-063e-460d-87d4-95e4321214c4',volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:18:12.988185 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8b3fd6ae-59ce-4c0b-85e4-d539d9b0f567 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.306559 Jun 30 04:18:12.989054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 173/364] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:18:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:18:12.998880 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4e168cc1-ccf9-4d56-a9b6-904da617fd68 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:12.999519 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4e168cc1-ccf9-4d56-a9b6-904da617fd68 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:13.057169 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4e168cc1-ccf9-4d56-a9b6-904da617fd68 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:13.064193 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4e168cc1-ccf9-4d56-a9b6-904da617fd68 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1088 microversion: 2.1 time: 0.069172 Jun 30 04:18:13.064973 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 192/365] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:12 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:13.333103 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4cded0bb-5372-43a2-a2bf-44d578213df8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:13.333771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4cded0bb-5372-43a2-a2bf-44d578213df8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:13.342886 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4cded0bb-5372-43a2-a2bf-44d578213df8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:13.343366 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4cded0bb-5372-43a2-a2bf-44d578213df8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:13.344146 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4cded0bb-5372-43a2-a2bf-44d578213df8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:13.344638 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4cded0bb-5372-43a2-a2bf-44d578213df8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:13.478102 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4cded0bb-5372-43a2-a2bf-44d578213df8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:13.485665 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4cded0bb-5372-43a2-a2bf-44d578213df8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.156595 Jun 30 04:18:13.486236 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 174/366] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:13 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:13.670218 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6d9d1734-bb1e-4df0-96c3-bff0f4e67217 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:13.670898 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6d9d1734-bb1e-4df0-96c3-bff0f4e67217 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:13.677888 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6d9d1734-bb1e-4df0-96c3-bff0f4e67217 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:13.678340 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6d9d1734-bb1e-4df0-96c3-bff0f4e67217 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:13.679293 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6d9d1734-bb1e-4df0-96c3-bff0f4e67217 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:13.679746 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6d9d1734-bb1e-4df0-96c3-bff0f4e67217 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:13.810366 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6d9d1734-bb1e-4df0-96c3-bff0f4e67217 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:13.823962 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6d9d1734-bb1e-4df0-96c3-bff0f4e67217 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:13.826285 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6d9d1734-bb1e-4df0-96c3-bff0f4e67217 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:13.828153 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6d9d1734-bb1e-4df0-96c3-bff0f4e67217 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.161718 Jun 30 04:18:13.828835 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 193/367] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:13 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:14.085560 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5e5240c1-6d4c-4825-b1ec-223c13bf1f9b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:14.086627 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5e5240c1-6d4c-4825-b1ec-223c13bf1f9b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:14.100123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e5240c1-6d4c-4825-b1ec-223c13bf1f9b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:14.101224 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e5240c1-6d4c-4825-b1ec-223c13bf1f9b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:14.102002 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e5240c1-6d4c-4825-b1ec-223c13bf1f9b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:14.102444 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e5240c1-6d4c-4825-b1ec-223c13bf1f9b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:14.167436 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5e5240c1-6d4c-4825-b1ec-223c13bf1f9b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:14.175128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5e5240c1-6d4c-4825-b1ec-223c13bf1f9b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1138 microversion: 2.1 time: 0.096680 Jun 30 04:18:14.175698 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 175/368] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:14 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1138 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:14.243138 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-cb92a7a4-3365-4dc1-9209-5f7075cfcd46 req-eba7131a-84be-4fac-8cc1-c6b82f8f7fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3f3442-a00e-47ee-b0df-f099086628ce", "name": "network-vif-plugged", "status": "completed", "tag": "bd404336-185f-4a39-8576-5211044a2340"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:14.252623 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-cb92a7a4-3365-4dc1-9209-5f7075cfcd46 req-eba7131a-84be-4fac-8cc1-c6b82f8f7fcd service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:14.253160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-cb92a7a4-3365-4dc1-9209-5f7075cfcd46 req-eba7131a-84be-4fac-8cc1-c6b82f8f7fcd service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:14.265234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-cb92a7a4-3365-4dc1-9209-5f7075cfcd46 req-eba7131a-84be-4fac-8cc1-c6b82f8f7fcd service nova] Creating event network-vif-plugged:bd404336-185f-4a39-8576-5211044a2340 for instance 2d3f3442-a00e-47ee-b0df-f099086628ce on hv-cinder-84684 Jun 30 04:18:14.270251 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-cb92a7a4-3365-4dc1-9209-5f7075cfcd46 req-eba7131a-84be-4fac-8cc1-c6b82f8f7fcd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031066 Jun 30 04:18:14.271017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 194/369] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:14.506878 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8e7d3ed4-91b8-47f3-906f-bb49758ba0b4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:14.508393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8e7d3ed4-91b8-47f3-906f-bb49758ba0b4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:14.518614 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8e7d3ed4-91b8-47f3-906f-bb49758ba0b4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:14.519404 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8e7d3ed4-91b8-47f3-906f-bb49758ba0b4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:14.520647 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8e7d3ed4-91b8-47f3-906f-bb49758ba0b4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:14.521351 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8e7d3ed4-91b8-47f3-906f-bb49758ba0b4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:14.651615 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8e7d3ed4-91b8-47f3-906f-bb49758ba0b4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:14.659700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8e7d3ed4-91b8-47f3-906f-bb49758ba0b4 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.159472 Jun 30 04:18:14.660262 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 176/370] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:14 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:14.853971 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4ddede94-fd53-43ba-aa7f-1eb548e1be97 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:14.854766 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4ddede94-fd53-43ba-aa7f-1eb548e1be97 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:14.862828 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4ddede94-fd53-43ba-aa7f-1eb548e1be97 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:14.863449 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4ddede94-fd53-43ba-aa7f-1eb548e1be97 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:14.864379 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4ddede94-fd53-43ba-aa7f-1eb548e1be97 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:14.864910 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4ddede94-fd53-43ba-aa7f-1eb548e1be97 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:15.006997 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4ddede94-fd53-43ba-aa7f-1eb548e1be97 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:15.016600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4ddede94-fd53-43ba-aa7f-1eb548e1be97 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:15.018079 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4ddede94-fd53-43ba-aa7f-1eb548e1be97 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:15.019235 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4ddede94-fd53-43ba-aa7f-1eb548e1be97 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.172518 Jun 30 04:18:15.019796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 195/371] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:14 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:15.197086 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1ce3bc82-1994-46a8-aed0-9b4fa148a09a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:15.197938 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1ce3bc82-1994-46a8-aed0-9b4fa148a09a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:15.209108 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ce3bc82-1994-46a8-aed0-9b4fa148a09a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:15.209847 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ce3bc82-1994-46a8-aed0-9b4fa148a09a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:15.211216 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ce3bc82-1994-46a8-aed0-9b4fa148a09a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:15.211646 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ce3bc82-1994-46a8-aed0-9b4fa148a09a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:15.275857 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1ce3bc82-1994-46a8-aed0-9b4fa148a09a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:15.284560 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1ce3bc82-1994-46a8-aed0-9b4fa148a09a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1130 microversion: 2.1 time: 0.094393 Jun 30 04:18:15.285129 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 177/372] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:15 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1130 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:15.682095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c680907c-05a5-464a-9253-08d12e03f1af tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:15.683171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c680907c-05a5-464a-9253-08d12e03f1af tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:15.693363 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c680907c-05a5-464a-9253-08d12e03f1af tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:15.694099 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c680907c-05a5-464a-9253-08d12e03f1af tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:15.695271 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c680907c-05a5-464a-9253-08d12e03f1af tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:15.695704 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c680907c-05a5-464a-9253-08d12e03f1af tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:15.827016 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c680907c-05a5-464a-9253-08d12e03f1af tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:15.835769 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c680907c-05a5-464a-9253-08d12e03f1af tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.160152 Jun 30 04:18:15.836781 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 196/373] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:15 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:16.038492 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7f1edc7c-18e0-4adf-a679-ed887ae8c4da tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:16.039267 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7f1edc7c-18e0-4adf-a679-ed887ae8c4da tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:16.045117 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f1edc7c-18e0-4adf-a679-ed887ae8c4da tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:16.045561 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f1edc7c-18e0-4adf-a679-ed887ae8c4da tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:16.046320 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f1edc7c-18e0-4adf-a679-ed887ae8c4da tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:16.046740 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f1edc7c-18e0-4adf-a679-ed887ae8c4da tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:16.190423 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7f1edc7c-18e0-4adf-a679-ed887ae8c4da tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:16.199961 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7f1edc7c-18e0-4adf-a679-ed887ae8c4da tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:16.201584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7f1edc7c-18e0-4adf-a679-ed887ae8c4da tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:16.202977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7f1edc7c-18e0-4adf-a679-ed887ae8c4da tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.168612 Jun 30 04:18:16.203588 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 178/374] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:16 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:16.308462 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c221914c-f685-4867-9b9f-5575ff6af730 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:16.309814 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c221914c-f685-4867-9b9f-5575ff6af730 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:16.316427 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c221914c-f685-4867-9b9f-5575ff6af730 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:16.316981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c221914c-f685-4867-9b9f-5575ff6af730 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:16.317755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c221914c-f685-4867-9b9f-5575ff6af730 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:16.318324 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c221914c-f685-4867-9b9f-5575ff6af730 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:16.391852 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c221914c-f685-4867-9b9f-5575ff6af730 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:16.399838 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c221914c-f685-4867-9b9f-5575ff6af730 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1186 microversion: 2.1 time: 0.095515 Jun 30 04:18:16.400414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 197/375] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:16 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1186 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:16.853863 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-96852953-ad6f-49d9-9ae2-b31b73d0daff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:16.854304 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-96852953-ad6f-49d9-9ae2-b31b73d0daff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:16.862955 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-96852953-ad6f-49d9-9ae2-b31b73d0daff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:16.863559 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-96852953-ad6f-49d9-9ae2-b31b73d0daff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:16.865830 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-96852953-ad6f-49d9-9ae2-b31b73d0daff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:16.866392 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-96852953-ad6f-49d9-9ae2-b31b73d0daff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:17.068748 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-96852953-ad6f-49d9-9ae2-b31b73d0daff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:17.077588 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-96852953-ad6f-49d9-9ae2-b31b73d0daff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.228150 Jun 30 04:18:17.088178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 179/376] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:16 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:17.183671 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-669440242", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-814051584", "security_groups": [{"name": "tempest-secgroup-smoke-779380356"}], "block_device_mapping_v2": [{"uuid": "8fd904f2-9fe9-4391-8608-87ddd3a2b15c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "db2948ec-060f-4621-8ce6-8119698c91b1"}]}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:17.224981 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-789171fe-5e5f-4dae-b632-c3a0d88172e3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:17.226247 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-789171fe-5e5f-4dae-b632-c3a0d88172e3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:17.235858 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-789171fe-5e5f-4dae-b632-c3a0d88172e3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:17.236567 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-789171fe-5e5f-4dae-b632-c3a0d88172e3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:17.241798 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-789171fe-5e5f-4dae-b632-c3a0d88172e3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:17.241798 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-789171fe-5e5f-4dae-b632-c3a0d88172e3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:17.362212 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] validate_networks() for [('db2948ec-060f-4621-8ce6-8119698c91b1', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:18:17.534090 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-789171fe-5e5f-4dae-b632-c3a0d88172e3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:17.543374 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-789171fe-5e5f-4dae-b632-c3a0d88172e3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:17.544884 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-789171fe-5e5f-4dae-b632-c3a0d88172e3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:17.546055 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-789171fe-5e5f-4dae-b632-c3a0d88172e3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.327814 Jun 30 04:18:17.546578 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 180/377] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:17 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:18:17.561399 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-42aad634-5f84-422a-8704-5d92bf09f4b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:17.562442 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-42aad634-5f84-422a-8704-5d92bf09f4b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:17.569718 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42aad634-5f84-422a-8704-5d92bf09f4b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:17.570595 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42aad634-5f84-422a-8704-5d92bf09f4b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:17.571424 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42aad634-5f84-422a-8704-5d92bf09f4b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:17.571984 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42aad634-5f84-422a-8704-5d92bf09f4b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:17.667857 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-42aad634-5f84-422a-8704-5d92bf09f4b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:17.671457 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:17.677001 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-42aad634-5f84-422a-8704-5d92bf09f4b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1204 microversion: 2.1 time: 0.119312 Jun 30 04:18:17.677578 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 181/378] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:17 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1204 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:18.065684 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:18:18.066424 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:18:18.067378 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:18:18.067780 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:18:18.068371 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:18:18.081185 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:18.081635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:18.082489 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:18.082956 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:18.096554 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ccfa4f4d-8be0-4c5d-b011-dd618fb4e3ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:18.097172 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ccfa4f4d-8be0-4c5d-b011-dd618fb4e3ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:18.103934 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Getting quotas for project c2fe0f4b2519494ea784cea098da6be3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:18:18.110056 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ccfa4f4d-8be0-4c5d-b011-dd618fb4e3ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:18.110611 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ccfa4f4d-8be0-4c5d-b011-dd618fb4e3ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:18.110902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Getting quotas for user e269c6a656ff4721911ae25657eeedca and project c2fe0f4b2519494ea784cea098da6be3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:18:18.111560 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ccfa4f4d-8be0-4c5d-b011-dd618fb4e3ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:18.111859 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ccfa4f4d-8be0-4c5d-b011-dd618fb4e3ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:18.187197 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:18:18.189504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8fd904f2-9fe9-4391-8608-87ddd3a2b15c',volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:18:18.393456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ccfa4f4d-8be0-4c5d-b011-dd618fb4e3ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:18.432665 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ccfa4f4d-8be0-4c5d-b011-dd618fb4e3ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.339603 Jun 30 04:18:18.434489 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 182/379] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:18 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:18.512245 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9338d6d6-5297-41cd-b4f6-e9619d6a4891 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.332583 Jun 30 04:18:18.513226 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 198/380] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:18:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:18:18.525466 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-491bfb72-f6fa-467f-8d5d-1c3dbf065314 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:18.526201 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-491bfb72-f6fa-467f-8d5d-1c3dbf065314 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:18.568307 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-56fc4e62-9250-43a1-8ce3-9669b4d80568 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:18.568969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-56fc4e62-9250-43a1-8ce3-9669b4d80568 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:18.583542 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-56fc4e62-9250-43a1-8ce3-9669b4d80568 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:18.583987 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-56fc4e62-9250-43a1-8ce3-9669b4d80568 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:18.584766 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-56fc4e62-9250-43a1-8ce3-9669b4d80568 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:18.590687 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-56fc4e62-9250-43a1-8ce3-9669b4d80568 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:19.090946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-491bfb72-f6fa-467f-8d5d-1c3dbf065314 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:19.100230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-491bfb72-f6fa-467f-8d5d-1c3dbf065314 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1093 microversion: 2.1 time: 0.579846 Jun 30 04:18:19.101386 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 183/381] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:18 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1093 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:19.118074 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c2080847-55f3-4894-9b10-9218d5ddc473 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:19.119152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c2080847-55f3-4894-9b10-9218d5ddc473 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:19.127392 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c2080847-55f3-4894-9b10-9218d5ddc473 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:19.128884 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c2080847-55f3-4894-9b10-9218d5ddc473 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:19.129913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c2080847-55f3-4894-9b10-9218d5ddc473 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:19.130517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c2080847-55f3-4894-9b10-9218d5ddc473 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:19.184946 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-56fc4e62-9250-43a1-8ce3-9669b4d80568 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:19.197521 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-56fc4e62-9250-43a1-8ce3-9669b4d80568 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:19.201713 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-56fc4e62-9250-43a1-8ce3-9669b4d80568 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:19.205506 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-56fc4e62-9250-43a1-8ce3-9669b4d80568 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.643379 Jun 30 04:18:19.208762 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 199/382] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:18 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:19.332892 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c2080847-55f3-4894-9b10-9218d5ddc473 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:19.341363 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c2080847-55f3-4894-9b10-9218d5ddc473 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.238572 Jun 30 04:18:19.342537 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 184/383] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:19 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:19.451859 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a6052750-b6c7-4eaf-befd-3a237ee72063 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:19.452530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a6052750-b6c7-4eaf-befd-3a237ee72063 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:19.459288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6052750-b6c7-4eaf-befd-3a237ee72063 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:19.459288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6052750-b6c7-4eaf-befd-3a237ee72063 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:19.460273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6052750-b6c7-4eaf-befd-3a237ee72063 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:19.460827 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6052750-b6c7-4eaf-befd-3a237ee72063 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:19.594710 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a6052750-b6c7-4eaf-befd-3a237ee72063 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:19.603038 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a6052750-b6c7-4eaf-befd-3a237ee72063 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.154922 Jun 30 04:18:19.603656 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 200/384] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:19 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:20.116980 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-19cdc3aa-5e95-4f0d-b62f-3307b3c1a548 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:20.118167 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-19cdc3aa-5e95-4f0d-b62f-3307b3c1a548 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:20.125218 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-19cdc3aa-5e95-4f0d-b62f-3307b3c1a548 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:20.125669 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-19cdc3aa-5e95-4f0d-b62f-3307b3c1a548 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:20.126438 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-19cdc3aa-5e95-4f0d-b62f-3307b3c1a548 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:20.127051 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-19cdc3aa-5e95-4f0d-b62f-3307b3c1a548 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:20.214504 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-19cdc3aa-5e95-4f0d-b62f-3307b3c1a548 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:20.226222 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9c72be23-4e07-409f-b055-f9f0f5256e1b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:20.226869 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9c72be23-4e07-409f-b055-f9f0f5256e1b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:20.231627 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-19cdc3aa-5e95-4f0d-b62f-3307b3c1a548 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1143 microversion: 2.1 time: 0.118572 Jun 30 04:18:20.232227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 185/385] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:20 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1143 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:20.244850 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9c72be23-4e07-409f-b055-f9f0f5256e1b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:20.245370 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9c72be23-4e07-409f-b055-f9f0f5256e1b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:20.246150 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9c72be23-4e07-409f-b055-f9f0f5256e1b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:20.246662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9c72be23-4e07-409f-b055-f9f0f5256e1b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:20.360270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3831a396-4997-4547-a063-ff6c516bae94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:20.362191 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3831a396-4997-4547-a063-ff6c516bae94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:20.378124 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3831a396-4997-4547-a063-ff6c516bae94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:20.379672 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3831a396-4997-4547-a063-ff6c516bae94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:20.381155 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3831a396-4997-4547-a063-ff6c516bae94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:20.383478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3831a396-4997-4547-a063-ff6c516bae94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:20.422186 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9c72be23-4e07-409f-b055-f9f0f5256e1b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:20.439702 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9c72be23-4e07-409f-b055-f9f0f5256e1b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:20.441788 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9c72be23-4e07-409f-b055-f9f0f5256e1b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:20.443480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9c72be23-4e07-409f-b055-f9f0f5256e1b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.221455 Jun 30 04:18:20.444451 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 201/386] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:20 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:20.524154 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3831a396-4997-4547-a063-ff6c516bae94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:20.538596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3831a396-4997-4547-a063-ff6c516bae94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.182034 Jun 30 04:18:20.539654 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 186/387] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:20 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:20.620272 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8a498464-8035-438b-a833-17808d60b1e0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:20.620937 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8a498464-8035-438b-a833-17808d60b1e0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:20.629234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8a498464-8035-438b-a833-17808d60b1e0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:20.629692 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8a498464-8035-438b-a833-17808d60b1e0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:20.631201 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8a498464-8035-438b-a833-17808d60b1e0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:20.631648 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8a498464-8035-438b-a833-17808d60b1e0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:20.785767 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8a498464-8035-438b-a833-17808d60b1e0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:20.794225 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8a498464-8035-438b-a833-17808d60b1e0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.178557 Jun 30 04:18:20.795328 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 202/388] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:20 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:21.249059 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-62f36af4-06cc-4a55-b2bb-f864f78669ca tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:21.250493 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-62f36af4-06cc-4a55-b2bb-f864f78669ca tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:21.257405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-62f36af4-06cc-4a55-b2bb-f864f78669ca tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:21.258110 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-62f36af4-06cc-4a55-b2bb-f864f78669ca tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:21.258899 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-62f36af4-06cc-4a55-b2bb-f864f78669ca tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:21.259338 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-62f36af4-06cc-4a55-b2bb-f864f78669ca tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:21.332188 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-62f36af4-06cc-4a55-b2bb-f864f78669ca tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:21.340171 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-62f36af4-06cc-4a55-b2bb-f864f78669ca tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1143 microversion: 2.1 time: 0.095215 Jun 30 04:18:21.340935 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 187/389] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:21 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1143 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:21.467276 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-98377501-f084-48ac-ad9d-c09aae6205f1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:21.467276 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-98377501-f084-48ac-ad9d-c09aae6205f1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:21.496338 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98377501-f084-48ac-ad9d-c09aae6205f1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:21.496783 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98377501-f084-48ac-ad9d-c09aae6205f1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:21.497569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98377501-f084-48ac-ad9d-c09aae6205f1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:21.498004 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98377501-f084-48ac-ad9d-c09aae6205f1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:21.557578 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bc5dcc0c-1c23-44fc-8a2a-1b0224be8ec3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:21.559443 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bc5dcc0c-1c23-44fc-8a2a-1b0224be8ec3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:21.584569 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc5dcc0c-1c23-44fc-8a2a-1b0224be8ec3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:21.585509 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc5dcc0c-1c23-44fc-8a2a-1b0224be8ec3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:21.586971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc5dcc0c-1c23-44fc-8a2a-1b0224be8ec3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:21.587674 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc5dcc0c-1c23-44fc-8a2a-1b0224be8ec3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:21.999202 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-98377501-f084-48ac-ad9d-c09aae6205f1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:22.008914 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-98377501-f084-48ac-ad9d-c09aae6205f1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:22.010868 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-98377501-f084-48ac-ad9d-c09aae6205f1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:22.012611 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-98377501-f084-48ac-ad9d-c09aae6205f1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1809 microversion: 2.20 time: 0.554509 Jun 30 04:18:22.017322 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bc5dcc0c-1c23-44fc-8a2a-1b0224be8ec3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:22.023218 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 203/390] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:21 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1809 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:18:22.028385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-222b3587-8256-49b7-b553-3677148eecbe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:22.029046 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-222b3587-8256-49b7-b553-3677148eecbe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:22.034237 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bc5dcc0c-1c23-44fc-8a2a-1b0224be8ec3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.482200 Jun 30 04:18:22.034983 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 188/391] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:21 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:22.040839 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-222b3587-8256-49b7-b553-3677148eecbe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:22.040839 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-222b3587-8256-49b7-b553-3677148eecbe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:22.040839 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-222b3587-8256-49b7-b553-3677148eecbe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:22.040839 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-222b3587-8256-49b7-b553-3677148eecbe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:22.047771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1285905239", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "networks": [{"uuid": "9c18043c-6376-4ef1-99e0-e3f0031cee26"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:22.049912 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=100 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:22.138717 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] validate_networks() for [('9c18043c-6376-4ef1-99e0-e3f0031cee26', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:18:22.431566 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-222b3587-8256-49b7-b553-3677148eecbe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:22.448166 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-222b3587-8256-49b7-b553-3677148eecbe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.423516 Jun 30 04:18:22.449072 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 204/392] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:22 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:22.464746 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3f4b1a03-8b40-44e5-87e4-520c9b8c077d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:22.465427 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3f4b1a03-8b40-44e5-87e4-520c9b8c077d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:22.472056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3f4b1a03-8b40-44e5-87e4-520c9b8c077d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:22.472624 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3f4b1a03-8b40-44e5-87e4-520c9b8c077d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:22.473532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3f4b1a03-8b40-44e5-87e4-520c9b8c077d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:22.474024 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3f4b1a03-8b40-44e5-87e4-520c9b8c077d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:22.663542 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3f4b1a03-8b40-44e5-87e4-520c9b8c077d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:22.678911 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3f4b1a03-8b40-44e5-87e4-520c9b8c077d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1209 microversion: 2.1 time: 0.228617 Jun 30 04:18:22.680588 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 205/393] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:22 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1209 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:22.691701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:23.031849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6dc2852c-da80-47f7-93af-9aa9f3b36960 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:23.033269 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6dc2852c-da80-47f7-93af-9aa9f3b36960 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:23.043978 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6dc2852c-da80-47f7-93af-9aa9f3b36960 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:23.049107 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6dc2852c-da80-47f7-93af-9aa9f3b36960 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:23.050692 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6dc2852c-da80-47f7-93af-9aa9f3b36960 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:23.051209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6dc2852c-da80-47f7-93af-9aa9f3b36960 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:23.363139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:18:23.363879 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:18:23.364529 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:18:23.365732 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:18:23.366354 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:18:23.388245 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:23.389070 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:23.390835 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:23.391615 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:23.434468 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Getting quotas for project 4a5e183a36084c9fb82f3a3f7d24402a. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:18:23.444134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Getting quotas for user abfd09ef27184291a36b43b6664740c5 and project 4a5e183a36084c9fb82f3a3f7d24402a. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:18:23.455780 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:18:23.458383 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:18:23.494581 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6dc2852c-da80-47f7-93af-9aa9f3b36960 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:23.510497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6dc2852c-da80-47f7-93af-9aa9f3b36960 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:23.513500 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6dc2852c-da80-47f7-93af-9aa9f3b36960 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:23.516918 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6dc2852c-da80-47f7-93af-9aa9f3b36960 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1796 microversion: 2.20 time: 0.487586 Jun 30 04:18:23.530529 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 206/394] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:18:23 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1796 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:18:23.535337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e22d44b1-8796-4e1c-bc59-1c8dda02dc24 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:23.536168 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e22d44b1-8796-4e1c-bc59-1c8dda02dc24 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:23.546986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e22d44b1-8796-4e1c-bc59-1c8dda02dc24 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:23.548462 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e22d44b1-8796-4e1c-bc59-1c8dda02dc24 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:23.549642 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e22d44b1-8796-4e1c-bc59-1c8dda02dc24 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:23.551393 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e22d44b1-8796-4e1c-bc59-1c8dda02dc24 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:23.556366 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d4c0ea20-c2cf-433b-913d-254db71e1d48 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.512896 Jun 30 04:18:23.557156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 189/395] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:18:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:18:23.567711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7a16b809-dcbc-4d8f-8633-58182c39313e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:23.568642 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7a16b809-dcbc-4d8f-8633-58182c39313e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:23.576826 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a16b809-dcbc-4d8f-8633-58182c39313e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:23.577537 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a16b809-dcbc-4d8f-8633-58182c39313e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:23.578572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a16b809-dcbc-4d8f-8633-58182c39313e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:23.579990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a16b809-dcbc-4d8f-8633-58182c39313e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:24.389922 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7a16b809-dcbc-4d8f-8633-58182c39313e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:24.401285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7a16b809-dcbc-4d8f-8633-58182c39313e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.837258 Jun 30 04:18:24.411776 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 190/396] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:23 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:24.417634 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7e6059bd-1594-4f53-8f98-5eac77f8262f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:24.418437 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7e6059bd-1594-4f53-8f98-5eac77f8262f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:24.427178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e22d44b1-8796-4e1c-bc59-1c8dda02dc24 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:24.436491 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e22d44b1-8796-4e1c-bc59-1c8dda02dc24 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.916737 Jun 30 04:18:24.438838 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 207/397] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:23 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:24.446881 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7e6059bd-1594-4f53-8f98-5eac77f8262f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:24.447568 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7e6059bd-1594-4f53-8f98-5eac77f8262f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:24.449074 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7e6059bd-1594-4f53-8f98-5eac77f8262f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:24.449661 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7e6059bd-1594-4f53-8f98-5eac77f8262f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:24.452497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-707abcd7-6b9f-4aae-bdfc-306f1772918c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:24.453394 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-707abcd7-6b9f-4aae-bdfc-306f1772918c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:24.468673 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-707abcd7-6b9f-4aae-bdfc-306f1772918c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:24.469549 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-707abcd7-6b9f-4aae-bdfc-306f1772918c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:24.470495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-707abcd7-6b9f-4aae-bdfc-306f1772918c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:24.472155 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-707abcd7-6b9f-4aae-bdfc-306f1772918c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:24.638329 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7e6059bd-1594-4f53-8f98-5eac77f8262f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:24.646081 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7e6059bd-1594-4f53-8f98-5eac77f8262f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1215 microversion: 2.1 time: 0.233010 Jun 30 04:18:24.646750 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 191/398] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:24 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:24.652130 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-dac795b4-23bb-46e4-bfc8-83bb2c54bfe7 req-7a730771-9f66-4036-beca-7c524ae7ac10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51354e88-a19f-433f-85b3-126269c921c4", "tag": "90e33ddf-37e0-40e5-ac04-e09a2cb58d98"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:24.653642 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-707abcd7-6b9f-4aae-bdfc-306f1772918c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:24.656075 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:24.666550 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-dac795b4-23bb-46e4-bfc8-83bb2c54bfe7 req-7a730771-9f66-4036-beca-7c524ae7ac10 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:24.667340 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-dac795b4-23bb-46e4-bfc8-83bb2c54bfe7 req-7a730771-9f66-4036-beca-7c524ae7ac10 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:24.668255 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-707abcd7-6b9f-4aae-bdfc-306f1772918c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1197 microversion: 2.1 time: 0.225854 Jun 30 04:18:24.668860 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 208/399] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:24 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:24.693247 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-dac795b4-23bb-46e4-bfc8-83bb2c54bfe7 req-7a730771-9f66-4036-beca-7c524ae7ac10 service nova] Creating event network-changed:90e33ddf-37e0-40e5-ac04-e09a2cb58d98 for instance 51354e88-a19f-433f-85b3-126269c921c4 on hv-cinder-84684 Jun 30 04:18:24.699026 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-dac795b4-23bb-46e4-bfc8-83bb2c54bfe7 req-7a730771-9f66-4036-beca-7c524ae7ac10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050791 Jun 30 04:18:24.700884 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 192/400] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:25.429622 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-178aa6e4-8e06-427f-a2ad-b0587870f176 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:25.430231 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-178aa6e4-8e06-427f-a2ad-b0587870f176 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:25.438766 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-178aa6e4-8e06-427f-a2ad-b0587870f176 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:25.439240 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-178aa6e4-8e06-427f-a2ad-b0587870f176 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:25.440023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-178aa6e4-8e06-427f-a2ad-b0587870f176 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:25.440450 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-178aa6e4-8e06-427f-a2ad-b0587870f176 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:25.459722 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-952ae742-5b17-4115-a457-15b900abf00e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:25.462388 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-952ae742-5b17-4115-a457-15b900abf00e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:25.475457 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-952ae742-5b17-4115-a457-15b900abf00e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:25.476223 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-952ae742-5b17-4115-a457-15b900abf00e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:25.477555 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-952ae742-5b17-4115-a457-15b900abf00e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:25.478183 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-952ae742-5b17-4115-a457-15b900abf00e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:25.995383 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-952ae742-5b17-4115-a457-15b900abf00e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:26.000686 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-178aa6e4-8e06-427f-a2ad-b0587870f176 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:26.013668 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-178aa6e4-8e06-427f-a2ad-b0587870f176 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.589017 Jun 30 04:18:26.015929 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-952ae742-5b17-4115-a457-15b900abf00e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.561084 Jun 30 04:18:26.016808 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 193/401] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:25 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:26.037714 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a294ef58-f6bc-405e-bf32-a66cb8db287c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:26.038441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a294ef58-f6bc-405e-bf32-a66cb8db287c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:26.039660 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 209/402] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:25 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:26.046744 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a294ef58-f6bc-405e-bf32-a66cb8db287c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:26.047525 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a294ef58-f6bc-405e-bf32-a66cb8db287c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:26.048481 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a294ef58-f6bc-405e-bf32-a66cb8db287c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:26.049085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a294ef58-f6bc-405e-bf32-a66cb8db287c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:26.049222 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0dcfdb19-038a-441c-bf9a-f374415ef9fc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:26.049904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0dcfdb19-038a-441c-bf9a-f374415ef9fc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:26.059255 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dcfdb19-038a-441c-bf9a-f374415ef9fc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:26.060051 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dcfdb19-038a-441c-bf9a-f374415ef9fc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:26.061155 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dcfdb19-038a-441c-bf9a-f374415ef9fc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:26.061780 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dcfdb19-038a-441c-bf9a-f374415ef9fc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:26.281700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a294ef58-f6bc-405e-bf32-a66cb8db287c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:26.295355 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a294ef58-f6bc-405e-bf32-a66cb8db287c tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1277 microversion: 2.1 time: 0.276997 Jun 30 04:18:26.297867 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 194/403] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:26 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1277 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:26.546428 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0dcfdb19-038a-441c-bf9a-f374415ef9fc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:26.559511 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0dcfdb19-038a-441c-bf9a-f374415ef9fc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.518189 Jun 30 04:18:26.585295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 210/404] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:26 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:27.038658 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b0975925-f426-473b-ab1b-026d130f0d95 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:27.040121 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b0975925-f426-473b-ab1b-026d130f0d95 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:27.042333 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-60c756d0-7ffd-4860-9242-8c35250a63ca tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:27.043189 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-60c756d0-7ffd-4860-9242-8c35250a63ca tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:27.054341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b0975925-f426-473b-ab1b-026d130f0d95 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:27.057524 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b0975925-f426-473b-ab1b-026d130f0d95 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:27.058661 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b0975925-f426-473b-ab1b-026d130f0d95 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:27.061030 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-60c756d0-7ffd-4860-9242-8c35250a63ca tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:27.061484 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-60c756d0-7ffd-4860-9242-8c35250a63ca tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:27.062242 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b0975925-f426-473b-ab1b-026d130f0d95 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:27.062356 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-60c756d0-7ffd-4860-9242-8c35250a63ca tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:27.062672 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-60c756d0-7ffd-4860-9242-8c35250a63ca tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:27.895928 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-60c756d0-7ffd-4860-9242-8c35250a63ca tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:27.905864 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-60c756d0-7ffd-4860-9242-8c35250a63ca tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.868018 Jun 30 04:18:27.919712 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 211/405] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:27 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:27.927252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6fe3e9c3-7404-4164-b360-435c84613762 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:27.930483 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6fe3e9c3-7404-4164-b360-435c84613762 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:27.935826 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b0975925-f426-473b-ab1b-026d130f0d95 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:27.946513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fe3e9c3-7404-4164-b360-435c84613762 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:27.947343 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fe3e9c3-7404-4164-b360-435c84613762 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:27.947567 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b0975925-f426-473b-ab1b-026d130f0d95 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.915184 Jun 30 04:18:27.948161 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 195/406] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:27 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:27.949560 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fe3e9c3-7404-4164-b360-435c84613762 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:27.950167 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fe3e9c3-7404-4164-b360-435c84613762 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:27.972427 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-29c7e544-f09a-4e84-8edb-9eb617df2256 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:27.973447 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-29c7e544-f09a-4e84-8edb-9eb617df2256 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:27.981343 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-29c7e544-f09a-4e84-8edb-9eb617df2256 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:27.982080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-29c7e544-f09a-4e84-8edb-9eb617df2256 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:27.983067 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-29c7e544-f09a-4e84-8edb-9eb617df2256 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:27.983750 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-29c7e544-f09a-4e84-8edb-9eb617df2256 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:28.092714 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:28.120773 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=8 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:28.365312 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6fe3e9c3-7404-4164-b360-435c84613762 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:28.398599 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6fe3e9c3-7404-4164-b360-435c84613762 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1319 microversion: 2.1 time: 0.477159 Jun 30 04:18:28.402052 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 212/407] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:27 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:28.490309 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-aeddc31b-0c96-4560-9ff7-1d657752cd55 req-fda66caf-3cbf-4ae1-8243-f7ad1c408b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a0dbf7-3345-49a9-9785-a36af6da4a5f", "tag": "a24525d3-4d16-4d0a-a3e9-14e74a52e46d"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:28.515764 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-aeddc31b-0c96-4560-9ff7-1d657752cd55 req-fda66caf-3cbf-4ae1-8243-f7ad1c408b1e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:28.522110 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-aeddc31b-0c96-4560-9ff7-1d657752cd55 req-fda66caf-3cbf-4ae1-8243-f7ad1c408b1e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:28.552034 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-aeddc31b-0c96-4560-9ff7-1d657752cd55 req-fda66caf-3cbf-4ae1-8243-f7ad1c408b1e service nova] Creating event network-changed:a24525d3-4d16-4d0a-a3e9-14e74a52e46d for instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f on hv-cinder-84684 Jun 30 04:18:28.562370 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-aeddc31b-0c96-4560-9ff7-1d657752cd55 req-fda66caf-3cbf-4ae1-8243-f7ad1c408b1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072567 Jun 30 04:18:28.563940 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 213/408] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:18:28.610048 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-29c7e544-f09a-4e84-8edb-9eb617df2256 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:28.623738 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-29c7e544-f09a-4e84-8edb-9eb617df2256 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.662028 Jun 30 04:18:28.624332 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 196/409] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:27 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:28.926005 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c454df7b-fb61-4cc8-b0cc-0114d2f11e55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:28.927492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c454df7b-fb61-4cc8-b0cc-0114d2f11e55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:28.934866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c454df7b-fb61-4cc8-b0cc-0114d2f11e55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:28.935682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c454df7b-fb61-4cc8-b0cc-0114d2f11e55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:28.936654 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c454df7b-fb61-4cc8-b0cc-0114d2f11e55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:28.937310 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c454df7b-fb61-4cc8-b0cc-0114d2f11e55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:28.965346 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-586ea539-5e72-4c34-9dfb-81bcc49e2f4a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:28.965967 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-586ea539-5e72-4c34-9dfb-81bcc49e2f4a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:28.982888 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-586ea539-5e72-4c34-9dfb-81bcc49e2f4a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:28.983640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-586ea539-5e72-4c34-9dfb-81bcc49e2f4a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:28.984549 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-586ea539-5e72-4c34-9dfb-81bcc49e2f4a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:28.985047 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-586ea539-5e72-4c34-9dfb-81bcc49e2f4a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:29.510341 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-586ea539-5e72-4c34-9dfb-81bcc49e2f4a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:29.519615 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-586ea539-5e72-4c34-9dfb-81bcc49e2f4a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.558948 Jun 30 04:18:29.527774 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 197/410] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:28 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:29.538571 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-320b42c6-ddc1-4d61-aec3-417f15d10d17 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:29.544826 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-320b42c6-ddc1-4d61-aec3-417f15d10d17 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:29.545621 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c454df7b-fb61-4cc8-b0cc-0114d2f11e55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:29.554258 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c454df7b-fb61-4cc8-b0cc-0114d2f11e55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.632421 Jun 30 04:18:29.561565 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-320b42c6-ddc1-4d61-aec3-417f15d10d17 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:29.571650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 214/411] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:28 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:29.572517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-320b42c6-ddc1-4d61-aec3-417f15d10d17 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:29.588310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-320b42c6-ddc1-4d61-aec3-417f15d10d17 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:29.588860 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-320b42c6-ddc1-4d61-aec3-417f15d10d17 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:29.639909 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-2024f3d4-6062-4c36-b48d-7e59f71f9970 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:29.640923 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-2024f3d4-6062-4c36-b48d-7e59f71f9970 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:29.657672 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2024f3d4-6062-4c36-b48d-7e59f71f9970 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:29.658218 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2024f3d4-6062-4c36-b48d-7e59f71f9970 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:29.659123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2024f3d4-6062-4c36-b48d-7e59f71f9970 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:29.659647 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2024f3d4-6062-4c36-b48d-7e59f71f9970 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:29.997706 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-320b42c6-ddc1-4d61-aec3-417f15d10d17 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:30.009945 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-320b42c6-ddc1-4d61-aec3-417f15d10d17 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1319 microversion: 2.1 time: 0.478089 Jun 30 04:18:30.011059 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 198/412] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:29 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:30.111425 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-2024f3d4-6062-4c36-b48d-7e59f71f9970 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:30.127309 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-2024f3d4-6062-4c36-b48d-7e59f71f9970 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.487152 Jun 30 04:18:30.140216 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 215/413] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:29 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:30.546561 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-65297c00-980a-4a08-a693-feaf4fc31f07 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:30.547737 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-65297c00-980a-4a08-a693-feaf4fc31f07 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:30.556226 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-65297c00-980a-4a08-a693-feaf4fc31f07 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:30.557075 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-65297c00-980a-4a08-a693-feaf4fc31f07 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:30.558809 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-65297c00-980a-4a08-a693-feaf4fc31f07 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:30.559498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-65297c00-980a-4a08-a693-feaf4fc31f07 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:30.578897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bcc5062d-53db-482c-895b-02a0b64b0faa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:30.579737 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-bcc5062d-53db-482c-895b-02a0b64b0faa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:30.596288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:30.598234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bcc5062d-53db-482c-895b-02a0b64b0faa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:30.598839 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bcc5062d-53db-482c-895b-02a0b64b0faa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:30.599821 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bcc5062d-53db-482c-895b-02a0b64b0faa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:30.600418 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bcc5062d-53db-482c-895b-02a0b64b0faa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:30.873595 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-65297c00-980a-4a08-a693-feaf4fc31f07 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:30.883170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-65297c00-980a-4a08-a693-feaf4fc31f07 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.342313 Jun 30 04:18:30.890252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 199/414] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:30 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:30.897977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-4e1d64ed-c5f7-44f6-9b22-555177e44ce2 req-ee5c2aab-6afc-4ba8-bb5b-3d22b6630cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef409b2-233a-4846-8e69-31ba8d23f79a", "tag": "af8ece6c-4794-4310-bde8-88faa37110ff"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:30.922247 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4e1d64ed-c5f7-44f6-9b22-555177e44ce2 req-ee5c2aab-6afc-4ba8-bb5b-3d22b6630cf7 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:30.922867 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4e1d64ed-c5f7-44f6-9b22-555177e44ce2 req-ee5c2aab-6afc-4ba8-bb5b-3d22b6630cf7 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:30.948906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-4e1d64ed-c5f7-44f6-9b22-555177e44ce2 req-ee5c2aab-6afc-4ba8-bb5b-3d22b6630cf7 service nova] Creating event network-changed:af8ece6c-4794-4310-bde8-88faa37110ff for instance eef409b2-233a-4846-8e69-31ba8d23f79a on hv-cinder-84684 Jun 30 04:18:30.958872 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-4e1d64ed-c5f7-44f6-9b22-555177e44ce2 req-ee5c2aab-6afc-4ba8-bb5b-3d22b6630cf7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066932 Jun 30 04:18:30.960707 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 200/415] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:30.984713 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-bcc5062d-53db-482c-895b-02a0b64b0faa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:30.997109 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bcc5062d-53db-482c-895b-02a0b64b0faa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1501 microversion: 2.1 time: 0.421472 Jun 30 04:18:31.001903 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 216/416] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:30 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:31.018395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9b1f1af1-c67c-48f2-91ff-c568d1339ebe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1a0644b-56f1-413b-b55a-3d8196d06aac"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:31.020348 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9b1f1af1-c67c-48f2-91ff-c568d1339ebe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:31.026329 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-36014340-a458-4864-9d10-c820c7c30280 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:31.027419 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-36014340-a458-4864-9d10-c820c7c30280 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:31.040714 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36014340-a458-4864-9d10-c820c7c30280 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.043566 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36014340-a458-4864-9d10-c820c7c30280 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.046379 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36014340-a458-4864-9d10-c820c7c30280 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.047023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36014340-a458-4864-9d10-c820c7c30280 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.052981 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b1f1af1-c67c-48f2-91ff-c568d1339ebe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.058035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b1f1af1-c67c-48f2-91ff-c568d1339ebe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.059067 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b1f1af1-c67c-48f2-91ff-c568d1339ebe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.059676 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b1f1af1-c67c-48f2-91ff-c568d1339ebe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.103119 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:31.151035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-9b1f1af1-c67c-48f2-91ff-c568d1339ebe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] HTTP exception thrown: Cannot 'attach_volume' instance b9a789ea-78f4-481d-bd9b-45bce25676ad while it is in vm_state rescued Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9b1f1af1-c67c-48f2-91ff-c568d1339ebe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Request method failure captured: Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: POST /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad/os-volume_attachments HTTP/1.1 Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 74 Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSOgW5TdQdIDnKRvRN6OMIhpIxAn2TKObfMVZ_JlbTYawaWtUqJSBAcUwPpiMbmhabkYxhVFA8mAfsXKkBB-sLhYFC6mMr2p3YJrMJjtEXUPxpHpeI0lkKEnL1xpp2Dw8Df0bDRkrrlKKYAeqTbtfqBunbiYcSLFxb4qb3NxzJ1LYcs Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 74b53f46d15c4465b9005939114e67a3 Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:18:31.152906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74b53f46d15c4465b9005939114e67a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_74b53f46d15c4465b9005939114e67a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74b53f46d15c4465b9005939114e67a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/74b53f46d15c4465b9005939114e67a3"}]}] Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 74b53f46d15c4465b9005939114e67a3 Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-ServerRescueNegativeTestJSON-1003299466-project Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: b6854699a1dc475ab11a89bcaf2af85a Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1003299466-project Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {"volumeAttachment": {"volumeId": "a1a0644b-56f1-413b-b55a-3d8196d06aac"}} Jun 30 04:18:31.154531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Cannot 'attach_volume' instance b9a789ea-78f4-481d-bd9b-45bce25676ad while it is in vm_state rescued Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'server_id': 'b9a789ea-78f4-481d-bd9b-45bce25676ad', 'body': {'volumeAttachment': {'volumeId': 'a1a0644b-56f1-413b-b55a-3d8196d06aac'}}} Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b9a789ea-78f4-481d-bd9b-45bce25676ad in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:18:31.155527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b9a789ea-78f4-481d-bd9b-45bce25676ad while it is in vm_state rescued Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:18:31.157219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:18:31.158978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:18:31.158978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:18:31.158978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b9a789ea-78f4-481d-bd9b-45bce25676ad while it is in vm_state rescued Jun 30 04:18:31.158978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:18:31.158978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9b1f1af1-c67c-48f2-91ff-c568d1339ebe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Returning 409 to user: Cannot 'attach_volume' instance b9a789ea-78f4-481d-bd9b-45bce25676ad while it is in vm_state rescued {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:18:31.158978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9b1f1af1-c67c-48f2-91ff-c568d1339ebe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.140359 Jun 30 04:18:31.159816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 201/417] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:18:31 2022] POST /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad/os-volume_attachments => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 04:18:31.165052 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f3798afc-3c48-42fc-b052-7b9f8cfcb491 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:31.165688 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f3798afc-3c48-42fc-b052-7b9f8cfcb491 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:31.172047 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3798afc-3c48-42fc-b052-7b9f8cfcb491 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.172487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3798afc-3c48-42fc-b052-7b9f8cfcb491 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.173259 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3798afc-3c48-42fc-b052-7b9f8cfcb491 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.173684 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3798afc-3c48-42fc-b052-7b9f8cfcb491 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.374080 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-36014340-a458-4864-9d10-c820c7c30280 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:31.383711 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-36014340-a458-4864-9d10-c820c7c30280 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1319 microversion: 2.1 time: 0.361241 Jun 30 04:18:31.384317 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 217/418] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:31 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:31.403472 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f14f4243-c2c2-4516-ac5b-6be61a55a74f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:31.404068 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f14f4243-c2c2-4516-ac5b-6be61a55a74f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:31.416269 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f14f4243-c2c2-4516-ac5b-6be61a55a74f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.416946 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f14f4243-c2c2-4516-ac5b-6be61a55a74f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.418060 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f14f4243-c2c2-4516-ac5b-6be61a55a74f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.418655 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f14f4243-c2c2-4516-ac5b-6be61a55a74f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.462797 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f3798afc-3c48-42fc-b052-7b9f8cfcb491 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:31.476776 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f3798afc-3c48-42fc-b052-7b9f8cfcb491 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.314779 Jun 30 04:18:31.477651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 202/419] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:31 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:31.527787 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f14f4243-c2c2-4516-ac5b-6be61a55a74f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad/action" status: 202 len: 0 microversion: 2.1 time: 0.135519 Jun 30 04:18:31.533890 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 218/420] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:18:31 2022] POST /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:18:31.540545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8517583d-da8c-47d1-8acc-443178854458 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:31.541183 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8517583d-da8c-47d1-8acc-443178854458 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:31.549497 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8517583d-da8c-47d1-8acc-443178854458 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.550696 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8517583d-da8c-47d1-8acc-443178854458 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.552557 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8517583d-da8c-47d1-8acc-443178854458 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.553335 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8517583d-da8c-47d1-8acc-443178854458 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.720457 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8517583d-da8c-47d1-8acc-443178854458 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:31.729059 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8517583d-da8c-47d1-8acc-443178854458 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1509 microversion: 2.1 time: 0.195392 Jun 30 04:18:31.730097 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 203/421] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:31 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:31.911588 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c3374811-7174-41e5-9777-d082a7f2d84c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:31.917685 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c3374811-7174-41e5-9777-d082a7f2d84c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:31.930890 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c3374811-7174-41e5-9777-d082a7f2d84c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.932151 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c3374811-7174-41e5-9777-d082a7f2d84c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:31.933725 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c3374811-7174-41e5-9777-d082a7f2d84c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:31.934754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c3374811-7174-41e5-9777-d082a7f2d84c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:32.090335 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c3374811-7174-41e5-9777-d082a7f2d84c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:32.109161 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c3374811-7174-41e5-9777-d082a7f2d84c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.206279 Jun 30 04:18:32.109757 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 219/422] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:31 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:32.402016 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6aa98688-0879-44f5-b173-1b476a1c07e3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:32.402609 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6aa98688-0879-44f5-b173-1b476a1c07e3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:32.410965 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6aa98688-0879-44f5-b173-1b476a1c07e3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:32.411453 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6aa98688-0879-44f5-b173-1b476a1c07e3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:32.412237 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6aa98688-0879-44f5-b173-1b476a1c07e3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:32.412679 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6aa98688-0879-44f5-b173-1b476a1c07e3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:32.494727 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9837b1f5-63a7-4a98-bedd-0a3b1e92b763 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:32.495380 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9837b1f5-63a7-4a98-bedd-0a3b1e92b763 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:32.505421 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9837b1f5-63a7-4a98-bedd-0a3b1e92b763 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:32.506112 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9837b1f5-63a7-4a98-bedd-0a3b1e92b763 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:32.506999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9837b1f5-63a7-4a98-bedd-0a3b1e92b763 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:32.508237 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9837b1f5-63a7-4a98-bedd-0a3b1e92b763 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:32.532481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:32.641866 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6aa98688-0879-44f5-b173-1b476a1c07e3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:32.653552 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6aa98688-0879-44f5-b173-1b476a1c07e3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1319 microversion: 2.1 time: 0.255294 Jun 30 04:18:32.654776 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 204/423] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:32 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:32.705130 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9837b1f5-63a7-4a98-bedd-0a3b1e92b763 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:32.713237 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9837b1f5-63a7-4a98-bedd-0a3b1e92b763 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.223144 Jun 30 04:18:32.714027 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 220/424] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:32 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:32.746222 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4f18f7c1-0e71-4c31-bbda-23f7e08b6ac1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:32.747089 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4f18f7c1-0e71-4c31-bbda-23f7e08b6ac1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:32.754447 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4f18f7c1-0e71-4c31-bbda-23f7e08b6ac1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:32.754974 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4f18f7c1-0e71-4c31-bbda-23f7e08b6ac1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:32.755844 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4f18f7c1-0e71-4c31-bbda-23f7e08b6ac1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:32.756346 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4f18f7c1-0e71-4c31-bbda-23f7e08b6ac1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:33.010440 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4f18f7c1-0e71-4c31-bbda-23f7e08b6ac1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:33.018466 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4f18f7c1-0e71-4c31-bbda-23f7e08b6ac1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1509 microversion: 2.1 time: 0.276054 Jun 30 04:18:33.029648 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 205/425] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:32 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1509 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:33.127450 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b61bf385-3716-4030-95a2-4c48b5079619 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:33.132460 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b61bf385-3716-4030-95a2-4c48b5079619 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:33.139988 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b61bf385-3716-4030-95a2-4c48b5079619 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:33.141131 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b61bf385-3716-4030-95a2-4c48b5079619 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:33.142189 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b61bf385-3716-4030-95a2-4c48b5079619 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:33.143769 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b61bf385-3716-4030-95a2-4c48b5079619 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:33.584518 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b61bf385-3716-4030-95a2-4c48b5079619 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:33.591274 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b61bf385-3716-4030-95a2-4c48b5079619 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.467656 Jun 30 04:18:33.604037 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 221/426] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:33 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:33.674178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-515a49e8-826c-4031-961b-ec0e1604855f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:33.675540 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-515a49e8-826c-4031-961b-ec0e1604855f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:33.678704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:33.679604 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=14 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:33.686032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-515a49e8-826c-4031-961b-ec0e1604855f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:33.687319 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-515a49e8-826c-4031-961b-ec0e1604855f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:33.688336 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-515a49e8-826c-4031-961b-ec0e1604855f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:33.688978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-515a49e8-826c-4031-961b-ec0e1604855f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:33.730295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-36ffbf50-bed4-43c3-83d9-2cf2d91dac61 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:33.730900 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-36ffbf50-bed4-43c3-83d9-2cf2d91dac61 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:33.737126 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36ffbf50-bed4-43c3-83d9-2cf2d91dac61 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:33.737561 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36ffbf50-bed4-43c3-83d9-2cf2d91dac61 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:33.747527 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36ffbf50-bed4-43c3-83d9-2cf2d91dac61 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:33.750601 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36ffbf50-bed4-43c3-83d9-2cf2d91dac61 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:34.380396 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-36ffbf50-bed4-43c3-83d9-2cf2d91dac61 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:34.390636 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-36ffbf50-bed4-43c3-83d9-2cf2d91dac61 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.664011 Jun 30 04:18:34.403325 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 222/427] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:33 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:34.410218 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-685b8d67-e60d-4e58-8c32-8ea7b1e48d96 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:34.412796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-685b8d67-e60d-4e58-8c32-8ea7b1e48d96 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:34.422672 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-685b8d67-e60d-4e58-8c32-8ea7b1e48d96 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:34.423564 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-685b8d67-e60d-4e58-8c32-8ea7b1e48d96 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:34.424574 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-685b8d67-e60d-4e58-8c32-8ea7b1e48d96 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:34.426017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-685b8d67-e60d-4e58-8c32-8ea7b1e48d96 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:34.438396 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-515a49e8-826c-4031-961b-ec0e1604855f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:34.475878 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-515a49e8-826c-4031-961b-ec0e1604855f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1319 microversion: 2.1 time: 0.806061 Jun 30 04:18:34.477816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 206/428] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:33 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1319 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:34.610052 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f36669a0-23f8-4d43-be32-bc11de05b103 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:34.610387 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f36669a0-23f8-4d43-be32-bc11de05b103 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:34.623124 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f36669a0-23f8-4d43-be32-bc11de05b103 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:34.623756 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f36669a0-23f8-4d43-be32-bc11de05b103 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:34.624718 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f36669a0-23f8-4d43-be32-bc11de05b103 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:34.625318 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f36669a0-23f8-4d43-be32-bc11de05b103 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:34.652648 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-685b8d67-e60d-4e58-8c32-8ea7b1e48d96 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:34.663313 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-685b8d67-e60d-4e58-8c32-8ea7b1e48d96 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1509 microversion: 2.1 time: 0.257856 Jun 30 04:18:34.663934 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 223/429] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:34 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:34.793849 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f36669a0-23f8-4d43-be32-bc11de05b103 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:34.804350 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f36669a0-23f8-4d43-be32-bc11de05b103 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.199841 Jun 30 04:18:34.805324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 207/430] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:34 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:35.417771 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-da34e5a6-6dec-4373-84f4-d6ce03f1e74f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:35.418738 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-da34e5a6-6dec-4373-84f4-d6ce03f1e74f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:35.428267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-da34e5a6-6dec-4373-84f4-d6ce03f1e74f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:35.433068 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-da34e5a6-6dec-4373-84f4-d6ce03f1e74f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:35.434356 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-da34e5a6-6dec-4373-84f4-d6ce03f1e74f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:35.434879 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-da34e5a6-6dec-4373-84f4-d6ce03f1e74f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:35.495689 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9f6080c0-066d-486d-b0bd-46d4506ba3a4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:35.496856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9f6080c0-066d-486d-b0bd-46d4506ba3a4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:35.512241 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f6080c0-066d-486d-b0bd-46d4506ba3a4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:35.512826 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f6080c0-066d-486d-b0bd-46d4506ba3a4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:35.513700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f6080c0-066d-486d-b0bd-46d4506ba3a4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:35.514197 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f6080c0-066d-486d-b0bd-46d4506ba3a4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:35.745235 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-da34e5a6-6dec-4373-84f4-d6ce03f1e74f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:35.756344 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-da34e5a6-6dec-4373-84f4-d6ce03f1e74f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.350900 Jun 30 04:18:35.757807 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 224/431] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:35 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:35.768226 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9f6080c0-066d-486d-b0bd-46d4506ba3a4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:35.771356 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0f40bcbf-f510-4be6-a991-ae8a6b11a290 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:35.772266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0f40bcbf-f510-4be6-a991-ae8a6b11a290 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:35.779034 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9f6080c0-066d-486d-b0bd-46d4506ba3a4 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1319 microversion: 2.1 time: 0.287143 Jun 30 04:18:35.789007 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0f40bcbf-f510-4be6-a991-ae8a6b11a290 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:35.789007 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0f40bcbf-f510-4be6-a991-ae8a6b11a290 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:35.789007 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0f40bcbf-f510-4be6-a991-ae8a6b11a290 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:35.789007 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0f40bcbf-f510-4be6-a991-ae8a6b11a290 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:35.790075 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 208/432] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:35 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:35.822223 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ce740dce-300a-4fcb-93ab-35e8946d08b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:35.824107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ce740dce-300a-4fcb-93ab-35e8946d08b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:35.834774 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce740dce-300a-4fcb-93ab-35e8946d08b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:35.835930 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce740dce-300a-4fcb-93ab-35e8946d08b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:35.836979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce740dce-300a-4fcb-93ab-35e8946d08b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:35.837640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce740dce-300a-4fcb-93ab-35e8946d08b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:36.000774 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0f40bcbf-f510-4be6-a991-ae8a6b11a290 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:36.016360 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0f40bcbf-f510-4be6-a991-ae8a6b11a290 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1509 microversion: 2.1 time: 0.254296 Jun 30 04:18:36.017353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 225/433] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:35 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:36.050372 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ce740dce-300a-4fcb-93ab-35e8946d08b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:36.060002 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ce740dce-300a-4fcb-93ab-35e8946d08b1 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.241869 Jun 30 04:18:36.071303 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 209/434] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:35 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:36.076227 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-9863b9f5-6b0a-4c5c-aa28-cb4ea39cccd9 req-dfcd9987-d16a-4c98-b791-cb9ede9a976c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef409b2-233a-4846-8e69-31ba8d23f79a", "name": "network-vif-plugged", "status": "completed", "tag": "af8ece6c-4794-4310-bde8-88faa37110ff"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:36.093222 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-9863b9f5-6b0a-4c5c-aa28-cb4ea39cccd9 req-dfcd9987-d16a-4c98-b791-cb9ede9a976c service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:36.094061 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-9863b9f5-6b0a-4c5c-aa28-cb4ea39cccd9 req-dfcd9987-d16a-4c98-b791-cb9ede9a976c service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:36.107879 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-9863b9f5-6b0a-4c5c-aa28-cb4ea39cccd9 req-dfcd9987-d16a-4c98-b791-cb9ede9a976c service nova] Creating event network-vif-plugged:af8ece6c-4794-4310-bde8-88faa37110ff for instance eef409b2-233a-4846-8e69-31ba8d23f79a on hv-cinder-84684 Jun 30 04:18:36.112944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-9863b9f5-6b0a-4c5c-aa28-cb4ea39cccd9 req-dfcd9987-d16a-4c98-b791-cb9ede9a976c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044120 Jun 30 04:18:36.113816 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 226/435] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:36.777416 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-97e1ef23-ee94-4ebd-97ff-49233211f699 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:36.778376 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-97e1ef23-ee94-4ebd-97ff-49233211f699 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:36.786920 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97e1ef23-ee94-4ebd-97ff-49233211f699 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:36.787422 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97e1ef23-ee94-4ebd-97ff-49233211f699 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:36.788315 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97e1ef23-ee94-4ebd-97ff-49233211f699 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:36.788736 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97e1ef23-ee94-4ebd-97ff-49233211f699 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:36.797919 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6306d225-7f7d-4aeb-a0e7-0348b009a233 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:36.798621 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6306d225-7f7d-4aeb-a0e7-0348b009a233 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:36.805437 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6306d225-7f7d-4aeb-a0e7-0348b009a233 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:36.806369 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6306d225-7f7d-4aeb-a0e7-0348b009a233 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:36.807322 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6306d225-7f7d-4aeb-a0e7-0348b009a233 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:36.807797 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6306d225-7f7d-4aeb-a0e7-0348b009a233 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:37.018100 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-97e1ef23-ee94-4ebd-97ff-49233211f699 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:37.022707 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6306d225-7f7d-4aeb-a0e7-0348b009a233 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:37.028986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-97e1ef23-ee94-4ebd-97ff-49233211f699 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.257834 Jun 30 04:18:37.029887 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 210/436] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:36 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:37.035431 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6306d225-7f7d-4aeb-a0e7-0348b009a233 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1319 microversion: 2.1 time: 0.242342 Jun 30 04:18:37.037166 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e8f5494a-559a-4bff-b2aa-bdcc3d1d1c64 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:37.038026 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e8f5494a-559a-4bff-b2aa-bdcc3d1d1c64 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:37.045082 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 227/437] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:36 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:37.046081 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e8f5494a-559a-4bff-b2aa-bdcc3d1d1c64 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:37.046614 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e8f5494a-559a-4bff-b2aa-bdcc3d1d1c64 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:37.047461 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e8f5494a-559a-4bff-b2aa-bdcc3d1d1c64 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:37.048090 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e8f5494a-559a-4bff-b2aa-bdcc3d1d1c64 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:37.077996 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-25198c55-eb56-4805-8b1d-dcc609c4c0a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:37.080065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-25198c55-eb56-4805-8b1d-dcc609c4c0a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:37.087610 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-25198c55-eb56-4805-8b1d-dcc609c4c0a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:37.088437 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-25198c55-eb56-4805-8b1d-dcc609c4c0a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:37.088864 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-25198c55-eb56-4805-8b1d-dcc609c4c0a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:37.089291 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-25198c55-eb56-4805-8b1d-dcc609c4c0a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:37.479802 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e8f5494a-559a-4bff-b2aa-bdcc3d1d1c64 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:37.488037 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e8f5494a-559a-4bff-b2aa-bdcc3d1d1c64 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1509 microversion: 2.1 time: 0.455411 Jun 30 04:18:37.491545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 211/438] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:37 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1509 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:37.499723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-25198c55-eb56-4805-8b1d-dcc609c4c0a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:37.509022 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-25198c55-eb56-4805-8b1d-dcc609c4c0a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.435310 Jun 30 04:18:37.521458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 228/439] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:37 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:38.052411 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-2b1a7c27-3f50-4cb4-87ba-0d186f7c1c6f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:38.053927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-151b1c6a-f599-4265-8957-30daff512c33 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:38.054926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-2b1a7c27-3f50-4cb4-87ba-0d186f7c1c6f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:38.056780 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-151b1c6a-f599-4265-8957-30daff512c33 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:38.071542 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2b1a7c27-3f50-4cb4-87ba-0d186f7c1c6f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:38.074420 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-151b1c6a-f599-4265-8957-30daff512c33 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:38.080584 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2b1a7c27-3f50-4cb4-87ba-0d186f7c1c6f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:38.081439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-151b1c6a-f599-4265-8957-30daff512c33 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:38.082604 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2b1a7c27-3f50-4cb4-87ba-0d186f7c1c6f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:38.083938 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-151b1c6a-f599-4265-8957-30daff512c33 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:38.084522 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2b1a7c27-3f50-4cb4-87ba-0d186f7c1c6f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:38.085113 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-151b1c6a-f599-4265-8957-30daff512c33 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:38.381042 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-151b1c6a-f599-4265-8957-30daff512c33 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:38.390044 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-151b1c6a-f599-4265-8957-30daff512c33 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.347282 Jun 30 04:18:38.392570 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 212/440] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:38 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:38.398379 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-2b1a7c27-3f50-4cb4-87ba-0d186f7c1c6f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:38.409387 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-2b1a7c27-3f50-4cb4-87ba-0d186f7c1c6f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1319 microversion: 2.1 time: 0.361826 Jun 30 04:18:38.413401 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-1d6ab5ac-021f-41d5-a831-fa7274bf1ca1 req-37b160a6-469e-4c12-8fab-ba95fb865225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51354e88-a19f-433f-85b3-126269c921c4", "name": "network-vif-plugged", "status": "completed", "tag": "90e33ddf-37e0-40e5-ac04-e09a2cb58d98"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:38.420313 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 229/441] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:38 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:38.422199 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-1d6ab5ac-021f-41d5-a831-fa7274bf1ca1 req-37b160a6-469e-4c12-8fab-ba95fb865225 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:38.422795 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-1d6ab5ac-021f-41d5-a831-fa7274bf1ca1 req-37b160a6-469e-4c12-8fab-ba95fb865225 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:38.437586 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-1d6ab5ac-021f-41d5-a831-fa7274bf1ca1 req-37b160a6-469e-4c12-8fab-ba95fb865225 service nova] Creating event network-vif-plugged:90e33ddf-37e0-40e5-ac04-e09a2cb58d98 for instance 51354e88-a19f-433f-85b3-126269c921c4 on hv-cinder-84684 Jun 30 04:18:38.442741 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-1d6ab5ac-021f-41d5-a831-fa7274bf1ca1 req-37b160a6-469e-4c12-8fab-ba95fb865225 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047952 Jun 30 04:18:38.444454 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 213/442] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:38.508530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-370a85fe-817f-4490-9efa-d4dab2af3899 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:38.509136 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-370a85fe-817f-4490-9efa-d4dab2af3899 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:38.518843 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-370a85fe-817f-4490-9efa-d4dab2af3899 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:38.519320 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-370a85fe-817f-4490-9efa-d4dab2af3899 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:38.520358 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-370a85fe-817f-4490-9efa-d4dab2af3899 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:38.520735 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-370a85fe-817f-4490-9efa-d4dab2af3899 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:38.529336 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7c5bdf74-d775-487d-9406-780328e9e799 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:38.530439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7c5bdf74-d775-487d-9406-780328e9e799 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:38.547145 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c5bdf74-d775-487d-9406-780328e9e799 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:38.549095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c5bdf74-d775-487d-9406-780328e9e799 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:38.550998 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c5bdf74-d775-487d-9406-780328e9e799 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:38.552139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c5bdf74-d775-487d-9406-780328e9e799 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:38.838023 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7c5bdf74-d775-487d-9406-780328e9e799 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:38.846815 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7c5bdf74-d775-487d-9406-780328e9e799 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.324513 Jun 30 04:18:38.862183 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 214/443] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:38 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:38.866600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-370a85fe-817f-4490-9efa-d4dab2af3899 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:38.875322 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-370a85fe-817f-4490-9efa-d4dab2af3899 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1515 microversion: 2.1 time: 0.370823 Jun 30 04:18:38.879133 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 230/444] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:38 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1515 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:39.410246 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1a049493-f464-4aca-b444-c4bf845a064f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:39.412013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1a049493-f464-4aca-b444-c4bf845a064f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:39.419361 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1a049493-f464-4aca-b444-c4bf845a064f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:39.420135 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1a049493-f464-4aca-b444-c4bf845a064f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:39.421310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1a049493-f464-4aca-b444-c4bf845a064f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:39.421904 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1a049493-f464-4aca-b444-c4bf845a064f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:39.426317 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4dfe9e0e-18ea-49a9-a788-a052e4b2180f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:39.427131 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4dfe9e0e-18ea-49a9-a788-a052e4b2180f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:39.438748 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4dfe9e0e-18ea-49a9-a788-a052e4b2180f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:39.440197 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4dfe9e0e-18ea-49a9-a788-a052e4b2180f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:39.441135 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4dfe9e0e-18ea-49a9-a788-a052e4b2180f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:39.446574 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4dfe9e0e-18ea-49a9-a788-a052e4b2180f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:39.656695 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1a049493-f464-4aca-b444-c4bf845a064f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:39.674111 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1a049493-f464-4aca-b444-c4bf845a064f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.268401 Jun 30 04:18:39.675322 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 215/445] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:39 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:39.695819 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4dfe9e0e-18ea-49a9-a788-a052e4b2180f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:39.705209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4dfe9e0e-18ea-49a9-a788-a052e4b2180f tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1319 microversion: 2.1 time: 0.283045 Jun 30 04:18:39.706507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 231/446] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:39 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:39.864903 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-097d5b20-baa2-4901-be6d-ba30ecf8aaaa tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:39.866345 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-097d5b20-baa2-4901-be6d-ba30ecf8aaaa tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:39.873349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-097d5b20-baa2-4901-be6d-ba30ecf8aaaa tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:39.874281 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-097d5b20-baa2-4901-be6d-ba30ecf8aaaa tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:39.875379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-097d5b20-baa2-4901-be6d-ba30ecf8aaaa tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:39.876154 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-097d5b20-baa2-4901-be6d-ba30ecf8aaaa tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:40.043637 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-097d5b20-baa2-4901-be6d-ba30ecf8aaaa tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:40.052253 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-097d5b20-baa2-4901-be6d-ba30ecf8aaaa tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.191513 Jun 30 04:18:40.052937 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 216/447] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:39 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:40.373252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-2727de88-bf62-43c5-8ae9-c4f3740e7168 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'create', calling method: .version_select at 0x7fb4804625e0>, body: {"keypair": {"name": "tempest-keypair-1920684319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFflRGa0H0eawI9znmas6nFQ5UxnEuGWnwSCPRCSvxITLroVQeOPPY5a+j+XGe0DaAIm8JRK+Vyum5JINjaO7aEPKQeUxWAeTHdwiPEPqddiPpsXnzdUvBvOSKQ91fZ5WQ=="}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:40.391736 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-2727de88-bf62-43c5-8ae9-c4f3740e7168 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Getting quotas for project 74b53f46d15c4465b9005939114e67a3. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:18:40.396850 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-2727de88-bf62-43c5-8ae9-c4f3740e7168 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Getting quotas for user b6854699a1dc475ab11a89bcaf2af85a and project 74b53f46d15c4465b9005939114e67a3. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:18:40.467301 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-2727de88-bf62-43c5-8ae9-c4f3740e7168 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098253 Jun 30 04:18:40.467978 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 232/448] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 30 04:18:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:40.691284 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-87969660-5e07-4c0d-8bf7-157c48d56b1e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:40.691882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-87969660-5e07-4c0d-8bf7-157c48d56b1e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:40.701690 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87969660-5e07-4c0d-8bf7-157c48d56b1e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:40.702224 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87969660-5e07-4c0d-8bf7-157c48d56b1e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:40.703311 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87969660-5e07-4c0d-8bf7-157c48d56b1e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:40.704012 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87969660-5e07-4c0d-8bf7-157c48d56b1e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:40.722373 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7e8e506d-169f-435b-97d8-1b41068b14f3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:40.723385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7e8e506d-169f-435b-97d8-1b41068b14f3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:40.733848 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7e8e506d-169f-435b-97d8-1b41068b14f3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:40.738741 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7e8e506d-169f-435b-97d8-1b41068b14f3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:40.739854 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7e8e506d-169f-435b-97d8-1b41068b14f3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:40.741002 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7e8e506d-169f-435b-97d8-1b41068b14f3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:40.990276 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7e8e506d-169f-435b-97d8-1b41068b14f3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:41.000501 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7e8e506d-169f-435b-97d8-1b41068b14f3 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1508 microversion: 2.1 time: 0.282067 Jun 30 04:18:41.009631 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 233/449] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:40 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:41.020705 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9badb08a-575a-4fb8-be34-067d1e705754 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aefb6a60-0c9e-418b-b808-396c7bf4c06f", "device": "/dev/sdb"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:41.022496 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9badb08a-575a-4fb8-be34-067d1e705754 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:41.023878 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-87969660-5e07-4c0d-8bf7-157c48d56b1e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:41.029745 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9badb08a-575a-4fb8-be34-067d1e705754 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:41.030062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9badb08a-575a-4fb8-be34-067d1e705754 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:41.031309 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9badb08a-575a-4fb8-be34-067d1e705754 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:41.031658 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9badb08a-575a-4fb8-be34-067d1e705754 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:41.034198 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-87969660-5e07-4c0d-8bf7-157c48d56b1e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.347405 Jun 30 04:18:41.035053 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 217/450] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:40 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:41.069134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6ae26a93-d973-4e66-ba3f-491f70561399 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:41.070522 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6ae26a93-d973-4e66-ba3f-491f70561399 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:41.085283 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ae26a93-d973-4e66-ba3f-491f70561399 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:41.085950 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ae26a93-d973-4e66-ba3f-491f70561399 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:41.087413 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ae26a93-d973-4e66-ba3f-491f70561399 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:41.089963 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ae26a93-d973-4e66-ba3f-491f70561399 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:41.376095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6ae26a93-d973-4e66-ba3f-491f70561399 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:41.384603 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6ae26a93-d973-4e66-ba3f-491f70561399 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1260 microversion: 2.1 time: 0.319383 Jun 30 04:18:41.389485 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 218/451] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:41 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1260 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:41.493678 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9badb08a-575a-4fb8-be34-067d1e705754 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "POST /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.477494 Jun 30 04:18:41.500286 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 234/452] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:18:41 2022] POST /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:41.841614 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-eeafd4e3-cfb6-4dcf-91c1-7afb0907da8a req-963c0afa-0c0f-462a-9295-8acfdc53b25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a0dbf7-3345-49a9-9785-a36af6da4a5f", "name": "network-vif-plugged", "status": "completed", "tag": "a24525d3-4d16-4d0a-a3e9-14e74a52e46d"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:41.850046 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-eeafd4e3-cfb6-4dcf-91c1-7afb0907da8a req-963c0afa-0c0f-462a-9295-8acfdc53b25c service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:41.850550 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-eeafd4e3-cfb6-4dcf-91c1-7afb0907da8a req-963c0afa-0c0f-462a-9295-8acfdc53b25c service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:41.862810 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:41.865346 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-eeafd4e3-cfb6-4dcf-91c1-7afb0907da8a req-963c0afa-0c0f-462a-9295-8acfdc53b25c service nova] Creating event network-vif-plugged:a24525d3-4d16-4d0a-a3e9-14e74a52e46d for instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f on hv-cinder-84684 Jun 30 04:18:41.871263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-eeafd4e3-cfb6-4dcf-91c1-7afb0907da8a req-963c0afa-0c0f-462a-9295-8acfdc53b25c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033274 Jun 30 04:18:41.872489 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 219/453] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:42.055811 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7f5f274d-eb29-4407-a93b-11faae0df49d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:42.061833 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7f5f274d-eb29-4407-a93b-11faae0df49d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:42.073070 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7f5f274d-eb29-4407-a93b-11faae0df49d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:42.073929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7f5f274d-eb29-4407-a93b-11faae0df49d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:42.074955 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7f5f274d-eb29-4407-a93b-11faae0df49d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:42.076755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7f5f274d-eb29-4407-a93b-11faae0df49d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:42.404946 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7f5f274d-eb29-4407-a93b-11faae0df49d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:42.406583 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4efd9251-6135-4b89-b2f8-967c35af1f73 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:42.407613 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4efd9251-6135-4b89-b2f8-967c35af1f73 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:42.414923 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4efd9251-6135-4b89-b2f8-967c35af1f73 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:42.415240 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7f5f274d-eb29-4407-a93b-11faae0df49d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.364918 Jun 30 04:18:42.415852 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4efd9251-6135-4b89-b2f8-967c35af1f73 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:42.416914 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4efd9251-6135-4b89-b2f8-967c35af1f73 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:42.417541 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4efd9251-6135-4b89-b2f8-967c35af1f73 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:42.424505 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 235/454] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:42 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:42.593782 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4efd9251-6135-4b89-b2f8-967c35af1f73 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:42.601627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1350547326", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d053466e-8b12-41f1-8495-352ca2b58558"}], "security_groups": [{"name": "tempest-securitygroup--420438919"}], "key_name": "tempest-keypair-1920684319", "user_data": "}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:42.602202 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4efd9251-6135-4b89-b2f8-967c35af1f73 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1443 microversion: 2.1 time: 0.200196 Jun 30 04:18:42.602970 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 220/455] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:42 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1443 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:42.620850 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-65943421-c552-4069-9189-7d138f7cdc4e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:42.639671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-65943421-c552-4069-9189-7d138f7cdc4e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:42.646715 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-65943421-c552-4069-9189-7d138f7cdc4e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:42.648970 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-65943421-c552-4069-9189-7d138f7cdc4e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:42.651486 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-65943421-c552-4069-9189-7d138f7cdc4e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:42.652123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-65943421-c552-4069-9189-7d138f7cdc4e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:42.810575 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] validate_networks() for [('d053466e-8b12-41f1-8495-352ca2b58558', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:18:42.938595 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-65943421-c552-4069-9189-7d138f7cdc4e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:42.950450 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-65943421-c552-4069-9189-7d138f7cdc4e tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1443 microversion: 2.1 time: 0.333344 Jun 30 04:18:42.951847 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 221/456] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:42 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1443 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:43.435193 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4da82766-5eb0-4a07-9c9f-facf7dfda3b7 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:43.436226 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4da82766-5eb0-4a07-9c9f-facf7dfda3b7 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:43.450740 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4da82766-5eb0-4a07-9c9f-facf7dfda3b7 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:43.454334 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4da82766-5eb0-4a07-9c9f-facf7dfda3b7 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:43.455412 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4da82766-5eb0-4a07-9c9f-facf7dfda3b7 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:43.456396 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4da82766-5eb0-4a07-9c9f-facf7dfda3b7 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:43.628406 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:18:43.628924 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:18:43.630063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:18:43.630498 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:18:43.630920 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:18:43.649094 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:43.649624 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:43.653727 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:43.654216 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:43.679041 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4da82766-5eb0-4a07-9c9f-facf7dfda3b7 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:43.691369 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4da82766-5eb0-4a07-9c9f-facf7dfda3b7 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1264 microversion: 2.1 time: 0.262635 Jun 30 04:18:43.702967 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 222/457] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:43 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1264 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:43.716407 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Getting quotas for project 74b53f46d15c4465b9005939114e67a3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:18:43.721507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Getting quotas for user b6854699a1dc475ab11a89bcaf2af85a and project 74b53f46d15c4465b9005939114e67a3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:18:43.754822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:18:43.762826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:18:43.841017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-08d662b8-c1ba-4ddb-aa1a-9a6f14f22b61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.245565 Jun 30 04:18:43.846773 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 236/458] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:18:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:18:43.852244 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4fab5ccc-85df-4bdc-9a2c-a168ed1de921 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:43.852859 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4fab5ccc-85df-4bdc-9a2c-a168ed1de921 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:43.920778 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4fab5ccc-85df-4bdc-9a2c-a168ed1de921 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:43.930553 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4fab5ccc-85df-4bdc-9a2c-a168ed1de921 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1246 microversion: 2.1 time: 0.082206 Jun 30 04:18:43.931490 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 223/459] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:43 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:44.707602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-99b61efe-f7ea-4aad-a5db-0a1dd8abf6d4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:44.708213 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-99b61efe-f7ea-4aad-a5db-0a1dd8abf6d4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:44.712291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-304a48b6-154c-4a4e-838a-5832075bc116 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Action: 'create', calling method: .version_select at 0x7fb4805b0f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-297697838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGbQyRbWhfknbSCbwIJlz8M8yqxY8o205O2NS05lRLJFQAyXznxvAOF5aRt9ZhqKCkko2ke/BwxHf0Tw44PNfw7ZMCvTXe6gV6Eh7GrwkYVmyDxSxmaCbxmLxxmsJIewA=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:44.716635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-99b61efe-f7ea-4aad-a5db-0a1dd8abf6d4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:44.717294 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-99b61efe-f7ea-4aad-a5db-0a1dd8abf6d4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:44.718223 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-99b61efe-f7ea-4aad-a5db-0a1dd8abf6d4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:44.718650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-99b61efe-f7ea-4aad-a5db-0a1dd8abf6d4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:44.728349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-304a48b6-154c-4a4e-838a-5832075bc116 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Getting quotas for project bf207393082c48d09f827e16d99b2609. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:18:44.732274 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-304a48b6-154c-4a4e-838a-5832075bc116 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Getting quotas for user 17540f6ae3234debb5cfe7580f78d61d and project bf207393082c48d09f827e16d99b2609. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:18:44.760752 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-304a48b6-154c-4a4e-838a-5832075bc116 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052510 Jun 30 04:18:44.761366 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 224/460] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 30 04:18:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:18:44.812003 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1776249933", "imageRef": "2e579760-f062-4567-8a40-3b3d0c773b17", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-297697838", "networks": [{"uuid": "9f998a2a-5cb6-4bab-892c-06a6730a89bd"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:44.864004 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] validate_networks() for [('9f998a2a-5cb6-4bab-892c-06a6730a89bd', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:18:44.907901 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-99b61efe-f7ea-4aad-a5db-0a1dd8abf6d4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:44.916617 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-99b61efe-f7ea-4aad-a5db-0a1dd8abf6d4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1451 microversion: 2.1 time: 0.213165 Jun 30 04:18:44.927625 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 237/461] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:44 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1451 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:44.933889 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-853d02b9-5549-4ead-8b7a-d98f65237808 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:44.934500 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-853d02b9-5549-4ead-8b7a-d98f65237808 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:44.940861 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-853d02b9-5549-4ead-8b7a-d98f65237808 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:44.941305 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-853d02b9-5549-4ead-8b7a-d98f65237808 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:44.942058 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-853d02b9-5549-4ead-8b7a-d98f65237808 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:44.942486 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-853d02b9-5549-4ead-8b7a-d98f65237808 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:44.947126 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:45.237487 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-853d02b9-5549-4ead-8b7a-d98f65237808 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:45.248952 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-853d02b9-5549-4ead-8b7a-d98f65237808 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1451 microversion: 2.1 time: 0.318756 Jun 30 04:18:45.250366 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 238/462] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:44 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1451 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:45.270927 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b2fbf650-729d-4c5c-b610-64916aa77e59 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:45.273517 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b2fbf650-729d-4c5c-b610-64916aa77e59 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:45.288194 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b2fbf650-729d-4c5c-b610-64916aa77e59 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:45.289212 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b2fbf650-729d-4c5c-b610-64916aa77e59 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:45.291656 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b2fbf650-729d-4c5c-b610-64916aa77e59 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:45.292447 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b2fbf650-729d-4c5c-b610-64916aa77e59 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:45.370471 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b2fbf650-729d-4c5c-b610-64916aa77e59 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:45.381145 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b2fbf650-729d-4c5c-b610-64916aa77e59 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1304 microversion: 2.1 time: 0.120963 Jun 30 04:18:45.382319 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 239/463] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:45 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:45.388416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-a1684872-ac92-47e5-8074-5314d6a398f4 req-c126dae6-dea9-46c5-8c2d-503394e94fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51354e88-a19f-433f-85b3-126269c921c4", "tag": "90e33ddf-37e0-40e5-ac04-e09a2cb58d98"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:45.398111 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-a1684872-ac92-47e5-8074-5314d6a398f4 req-c126dae6-dea9-46c5-8c2d-503394e94fae service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:45.398552 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-a1684872-ac92-47e5-8074-5314d6a398f4 req-c126dae6-dea9-46c5-8c2d-503394e94fae service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:45.412978 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-a1684872-ac92-47e5-8074-5314d6a398f4 req-c126dae6-dea9-46c5-8c2d-503394e94fae service nova] Creating event network-changed:90e33ddf-37e0-40e5-ac04-e09a2cb58d98 for instance 51354e88-a19f-433f-85b3-126269c921c4 on hv-cinder-84684 Jun 30 04:18:45.419608 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-a1684872-ac92-47e5-8074-5314d6a398f4 req-c126dae6-dea9-46c5-8c2d-503394e94fae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035972 Jun 30 04:18:45.420670 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 240/464] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:45.613874 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:18:45.614645 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:18:45.615513 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:18:45.616257 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:18:45.617926 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:18:45.630845 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:45.632322 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:45.633423 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:45.634438 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:45.653970 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Getting quotas for project bf207393082c48d09f827e16d99b2609. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:18:45.659205 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Getting quotas for user 17540f6ae3234debb5cfe7580f78d61d and project bf207393082c48d09f827e16d99b2609. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:18:45.675847 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:18:45.680394 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e579760-f062-4567-8a40-3b3d0c773b17',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:18:45.740326 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-aabcb355-93bd-4398-a9c7-965080b3e6dd tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932251 Jun 30 04:18:45.741939 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 225/465] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:18:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 04:18:45.754441 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d27ec107-2c76-407c-9f45-fcf2af543922 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:45.756750 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d27ec107-2c76-407c-9f45-fcf2af543922 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:45.925877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d27ec107-2c76-407c-9f45-fcf2af543922 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:45.943754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d27ec107-2c76-407c-9f45-fcf2af543922 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1258 microversion: 2.1 time: 0.192047 Jun 30 04:18:45.945600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 241/466] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:45 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:46.399766 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1a0c8b71-53a4-4b85-b5f0-4b3abad35baa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:46.401141 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1a0c8b71-53a4-4b85-b5f0-4b3abad35baa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:46.410564 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1a0c8b71-53a4-4b85-b5f0-4b3abad35baa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:46.412728 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1a0c8b71-53a4-4b85-b5f0-4b3abad35baa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:46.413754 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1a0c8b71-53a4-4b85-b5f0-4b3abad35baa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:46.414347 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1a0c8b71-53a4-4b85-b5f0-4b3abad35baa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:46.587300 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1a0c8b71-53a4-4b85-b5f0-4b3abad35baa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:46.599359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1a0c8b71-53a4-4b85-b5f0-4b3abad35baa tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1304 microversion: 2.1 time: 0.204142 Jun 30 04:18:46.610202 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 226/467] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:46 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:46.961807 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-2591cffb-6d6a-4e9c-98e9-a58c6ea9a530 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:46.962418 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-2591cffb-6d6a-4e9c-98e9-a58c6ea9a530 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:46.970246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2591cffb-6d6a-4e9c-98e9-a58c6ea9a530 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:46.970823 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2591cffb-6d6a-4e9c-98e9-a58c6ea9a530 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:46.971727 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2591cffb-6d6a-4e9c-98e9-a58c6ea9a530 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:46.972159 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2591cffb-6d6a-4e9c-98e9-a58c6ea9a530 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:47.067080 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-2591cffb-6d6a-4e9c-98e9-a58c6ea9a530 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:47.085978 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-2591cffb-6d6a-4e9c-98e9-a58c6ea9a530 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1310 microversion: 2.1 time: 0.125297 Jun 30 04:18:47.088065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 242/468] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:46 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1310 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:47.557058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-07de17c0-ffaf-4f42-a81b-51215b5ab178 req-59fbd187-f377-4246-9d3c-89f312433ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a0dbf7-3345-49a9-9785-a36af6da4a5f", "tag": "a24525d3-4d16-4d0a-a3e9-14e74a52e46d"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:47.567327 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-07de17c0-ffaf-4f42-a81b-51215b5ab178 req-59fbd187-f377-4246-9d3c-89f312433ccc service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:47.567769 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-07de17c0-ffaf-4f42-a81b-51215b5ab178 req-59fbd187-f377-4246-9d3c-89f312433ccc service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:47.582367 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-07de17c0-ffaf-4f42-a81b-51215b5ab178 req-59fbd187-f377-4246-9d3c-89f312433ccc service nova] Creating event network-changed:a24525d3-4d16-4d0a-a3e9-14e74a52e46d for instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f on hv-cinder-84684 Jun 30 04:18:47.588858 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-07de17c0-ffaf-4f42-a81b-51215b5ab178 req-59fbd187-f377-4246-9d3c-89f312433ccc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035826 Jun 30 04:18:47.589523 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 227/469] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:47.619718 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6751740d-217d-4166-b8d0-64e137a7f878 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:47.620633 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6751740d-217d-4166-b8d0-64e137a7f878 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:47.628470 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6751740d-217d-4166-b8d0-64e137a7f878 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:47.629377 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6751740d-217d-4166-b8d0-64e137a7f878 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:47.630496 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6751740d-217d-4166-b8d0-64e137a7f878 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:47.636381 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6751740d-217d-4166-b8d0-64e137a7f878 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:48.105979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-59d499fa-ff01-4dd1-87ee-c1512c37c178 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:48.106841 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-59d499fa-ff01-4dd1-87ee-c1512c37c178 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:48.110706 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:48.120990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-59d499fa-ff01-4dd1-87ee-c1512c37c178 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:48.121636 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-59d499fa-ff01-4dd1-87ee-c1512c37c178 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:48.122705 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-59d499fa-ff01-4dd1-87ee-c1512c37c178 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:48.123509 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-59d499fa-ff01-4dd1-87ee-c1512c37c178 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:48.239763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-59d499fa-ff01-4dd1-87ee-c1512c37c178 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:48.252850 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-59d499fa-ff01-4dd1-87ee-c1512c37c178 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1316 microversion: 2.1 time: 0.151389 Jun 30 04:18:48.263697 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 228/470] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:48 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:48.370650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6751740d-217d-4166-b8d0-64e137a7f878 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:48.380264 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6751740d-217d-4166-b8d0-64e137a7f878 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.766101 Jun 30 04:18:48.380935 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 243/471] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:47 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:48.710558 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-91e9d00b-31ec-4e60-974f-ae5b6b0e064f req-3745daa6-3394-44c1-976d-d19e87d21202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99", "tag": "2a4fd84e-fb19-4d1c-b772-2251c8322151"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:18:48.728539 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-91e9d00b-31ec-4e60-974f-ae5b6b0e064f req-3745daa6-3394-44c1-976d-d19e87d21202 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:48.733814 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-91e9d00b-31ec-4e60-974f-ae5b6b0e064f req-3745daa6-3394-44c1-976d-d19e87d21202 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:48.759520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-91e9d00b-31ec-4e60-974f-ae5b6b0e064f req-3745daa6-3394-44c1-976d-d19e87d21202 service nova] Creating event network-changed:2a4fd84e-fb19-4d1c-b772-2251c8322151 for instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 on hv-cinder-84684 Jun 30 04:18:48.770822 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-91e9d00b-31ec-4e60-974f-ae5b6b0e064f req-3745daa6-3394-44c1-976d-d19e87d21202 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064867 Jun 30 04:18:48.772252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 229/472] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:18:49.270886 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5b23c55e-3cb3-4682-953b-51829cc96f8e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:49.271528 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5b23c55e-3cb3-4682-953b-51829cc96f8e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:49.278236 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5b23c55e-3cb3-4682-953b-51829cc96f8e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:49.278680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5b23c55e-3cb3-4682-953b-51829cc96f8e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:49.279682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5b23c55e-3cb3-4682-953b-51829cc96f8e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:49.280242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5b23c55e-3cb3-4682-953b-51829cc96f8e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:49.398632 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-071a72a4-55e7-48b4-8d65-41a8c3c78386 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:49.399351 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-071a72a4-55e7-48b4-8d65-41a8c3c78386 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:49.405989 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-071a72a4-55e7-48b4-8d65-41a8c3c78386 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:49.406619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-071a72a4-55e7-48b4-8d65-41a8c3c78386 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:49.407221 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-071a72a4-55e7-48b4-8d65-41a8c3c78386 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:49.407649 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-071a72a4-55e7-48b4-8d65-41a8c3c78386 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:49.421374 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5b23c55e-3cb3-4682-953b-51829cc96f8e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:49.430134 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5b23c55e-3cb3-4682-953b-51829cc96f8e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.162976 Jun 30 04:18:49.431363 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 244/473] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:49 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:49.559658 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-071a72a4-55e7-48b4-8d65-41a8c3c78386 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:49.567661 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-071a72a4-55e7-48b4-8d65-41a8c3c78386 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.173482 Jun 30 04:18:49.568270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 230/474] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:49 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:50.449010 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6fc54673-11a9-4a19-8570-dea535e39067 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:50.449585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6fc54673-11a9-4a19-8570-dea535e39067 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:50.456242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fc54673-11a9-4a19-8570-dea535e39067 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:50.456677 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fc54673-11a9-4a19-8570-dea535e39067 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:50.457417 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fc54673-11a9-4a19-8570-dea535e39067 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:50.457836 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fc54673-11a9-4a19-8570-dea535e39067 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:50.586548 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-911d19b1-ce36-4cc9-9ef9-67a285ed60ff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:50.587435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-911d19b1-ce36-4cc9-9ef9-67a285ed60ff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:50.594752 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-911d19b1-ce36-4cc9-9ef9-67a285ed60ff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:50.595229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-911d19b1-ce36-4cc9-9ef9-67a285ed60ff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:50.596005 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-911d19b1-ce36-4cc9-9ef9-67a285ed60ff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:50.596286 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6fc54673-11a9-4a19-8570-dea535e39067 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:50.596430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-911d19b1-ce36-4cc9-9ef9-67a285ed60ff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:50.605181 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6fc54673-11a9-4a19-8570-dea535e39067 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.160541 Jun 30 04:18:50.607808 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 245/475] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:50 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:50.748774 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-911d19b1-ce36-4cc9-9ef9-67a285ed60ff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:50.756694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-911d19b1-ce36-4cc9-9ef9-67a285ed60ff tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.175185 Jun 30 04:18:50.757580 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 231/476] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:50 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:51.622474 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-231bc9f8-4615-417a-bb74-69ea73e73ea3 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:51.623046 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-231bc9f8-4615-417a-bb74-69ea73e73ea3 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:51.630073 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-231bc9f8-4615-417a-bb74-69ea73e73ea3 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:51.630776 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-231bc9f8-4615-417a-bb74-69ea73e73ea3 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:51.641985 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-231bc9f8-4615-417a-bb74-69ea73e73ea3 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:51.641985 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-231bc9f8-4615-417a-bb74-69ea73e73ea3 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:51.773823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-83b08da1-5ea8-450d-90fa-a9dfe7e9906b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:51.774607 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-83b08da1-5ea8-450d-90fa-a9dfe7e9906b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:51.782010 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83b08da1-5ea8-450d-90fa-a9dfe7e9906b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:51.782753 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83b08da1-5ea8-450d-90fa-a9dfe7e9906b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:51.784020 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83b08da1-5ea8-450d-90fa-a9dfe7e9906b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:51.784519 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83b08da1-5ea8-450d-90fa-a9dfe7e9906b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:51.785789 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-231bc9f8-4615-417a-bb74-69ea73e73ea3 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:51.793832 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-231bc9f8-4615-417a-bb74-69ea73e73ea3 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.175342 Jun 30 04:18:51.794510 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 246/477] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:51 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:51.921618 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-83b08da1-5ea8-450d-90fa-a9dfe7e9906b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:51.929856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-83b08da1-5ea8-450d-90fa-a9dfe7e9906b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.159573 Jun 30 04:18:51.930451 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 232/478] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:51 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:52.811531 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f17a6b31-ae3b-4c2f-ab16-2159616c2353 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:52.812107 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f17a6b31-ae3b-4c2f-ab16-2159616c2353 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:52.819289 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f17a6b31-ae3b-4c2f-ab16-2159616c2353 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:52.819796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f17a6b31-ae3b-4c2f-ab16-2159616c2353 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:52.820602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f17a6b31-ae3b-4c2f-ab16-2159616c2353 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:52.821036 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f17a6b31-ae3b-4c2f-ab16-2159616c2353 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:52.947902 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a272869c-310e-4d8f-b703-53440c6897ad tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:52.948718 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a272869c-310e-4d8f-b703-53440c6897ad tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:52.955472 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a272869c-310e-4d8f-b703-53440c6897ad tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:52.955856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a272869c-310e-4d8f-b703-53440c6897ad tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:52.956672 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a272869c-310e-4d8f-b703-53440c6897ad tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:52.957107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a272869c-310e-4d8f-b703-53440c6897ad tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:52.965143 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f17a6b31-ae3b-4c2f-ab16-2159616c2353 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:52.972691 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f17a6b31-ae3b-4c2f-ab16-2159616c2353 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.165133 Jun 30 04:18:52.973270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 247/479] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:52 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:53.090372 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a272869c-310e-4d8f-b703-53440c6897ad tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:53.098132 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a272869c-310e-4d8f-b703-53440c6897ad tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.154817 Jun 30 04:18:53.098876 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 233/480] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:52 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:53.991142 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-16ca951a-a433-4e6c-8395-69538f7a7071 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:53.991925 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-16ca951a-a433-4e6c-8395-69538f7a7071 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:53.994107 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:54.000980 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-16ca951a-a433-4e6c-8395-69538f7a7071 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:54.001756 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-16ca951a-a433-4e6c-8395-69538f7a7071 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:54.002594 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-16ca951a-a433-4e6c-8395-69538f7a7071 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:54.003254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-16ca951a-a433-4e6c-8395-69538f7a7071 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:54.115685 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3805e149-2f39-4e31-bb58-7a6a3bb8432a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:54.116339 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3805e149-2f39-4e31-bb58-7a6a3bb8432a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:54.123348 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3805e149-2f39-4e31-bb58-7a6a3bb8432a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:54.123827 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3805e149-2f39-4e31-bb58-7a6a3bb8432a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:54.124593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3805e149-2f39-4e31-bb58-7a6a3bb8432a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:54.125028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3805e149-2f39-4e31-bb58-7a6a3bb8432a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:54.141199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-16ca951a-a433-4e6c-8395-69538f7a7071 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:54.149164 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-16ca951a-a433-4e6c-8395-69538f7a7071 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.161981 Jun 30 04:18:54.149755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 248/481] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:53 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:54.296968 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3805e149-2f39-4e31-bb58-7a6a3bb8432a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:54.305778 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3805e149-2f39-4e31-bb58-7a6a3bb8432a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.194263 Jun 30 04:18:54.306376 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 234/482] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:54 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:55.168063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4b2c2987-78e7-4ac0-ad16-fdfd97c982b1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:55.169290 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4b2c2987-78e7-4ac0-ad16-fdfd97c982b1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:55.176058 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b2c2987-78e7-4ac0-ad16-fdfd97c982b1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:55.176762 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b2c2987-78e7-4ac0-ad16-fdfd97c982b1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:55.177536 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b2c2987-78e7-4ac0-ad16-fdfd97c982b1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:55.177969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b2c2987-78e7-4ac0-ad16-fdfd97c982b1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:55.323756 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d30cf67b-3584-42a8-92dc-c7783ef9c2d5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:55.325221 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d30cf67b-3584-42a8-92dc-c7783ef9c2d5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:55.333043 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d30cf67b-3584-42a8-92dc-c7783ef9c2d5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:55.333871 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d30cf67b-3584-42a8-92dc-c7783ef9c2d5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:55.334875 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d30cf67b-3584-42a8-92dc-c7783ef9c2d5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:55.336034 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d30cf67b-3584-42a8-92dc-c7783ef9c2d5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:55.350301 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4b2c2987-78e7-4ac0-ad16-fdfd97c982b1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:55.358591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4b2c2987-78e7-4ac0-ad16-fdfd97c982b1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.194915 Jun 30 04:18:55.365498 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 249/483] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:55 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:55.482501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d30cf67b-3584-42a8-92dc-c7783ef9c2d5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:55.490100 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d30cf67b-3584-42a8-92dc-c7783ef9c2d5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.170793 Jun 30 04:18:55.490746 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 235/484] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:55 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:56.380481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7d36980f-9560-4492-b270-becbcb5861fe tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:56.381184 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7d36980f-9560-4492-b270-becbcb5861fe tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:56.383755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=12 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:56.390437 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d36980f-9560-4492-b270-becbcb5861fe tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:56.390876 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d36980f-9560-4492-b270-becbcb5861fe tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:56.391828 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d36980f-9560-4492-b270-becbcb5861fe tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:56.392255 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d36980f-9560-4492-b270-becbcb5861fe tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:56.508243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-33b60d20-1fda-4c37-bed0-d171166e66de tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:56.509431 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-33b60d20-1fda-4c37-bed0-d171166e66de tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:56.511298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:56.512335 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=12 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:56.522835 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-33b60d20-1fda-4c37-bed0-d171166e66de tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:56.533535 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-33b60d20-1fda-4c37-bed0-d171166e66de tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:56.534720 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-33b60d20-1fda-4c37-bed0-d171166e66de tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:56.535374 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-33b60d20-1fda-4c37-bed0-d171166e66de tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:56.540687 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7d36980f-9560-4492-b270-becbcb5861fe tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:56.552616 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7d36980f-9560-4492-b270-becbcb5861fe tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.177971 Jun 30 04:18:56.553441 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 250/485] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:56 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:56.688311 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-33b60d20-1fda-4c37-bed0-d171166e66de tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:56.697103 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-33b60d20-1fda-4c37-bed0-d171166e66de tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.192653 Jun 30 04:18:56.697669 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 236/486] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:56 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:57.575044 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d66d64b2-4725-43a0-b663-43ebff1340e4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:57.575044 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d66d64b2-4725-43a0-b663-43ebff1340e4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:57.584276 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d66d64b2-4725-43a0-b663-43ebff1340e4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:57.584276 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d66d64b2-4725-43a0-b663-43ebff1340e4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:57.584276 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d66d64b2-4725-43a0-b663-43ebff1340e4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:57.584276 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d66d64b2-4725-43a0-b663-43ebff1340e4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:57.713820 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7a7b58ee-dd82-4a2b-8987-9a9a602b52b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:57.714586 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7a7b58ee-dd82-4a2b-8987-9a9a602b52b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:57.721332 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a7b58ee-dd82-4a2b-8987-9a9a602b52b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:57.721757 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a7b58ee-dd82-4a2b-8987-9a9a602b52b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:57.722519 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a7b58ee-dd82-4a2b-8987-9a9a602b52b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:57.722949 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a7b58ee-dd82-4a2b-8987-9a9a602b52b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:57.726839 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d66d64b2-4725-43a0-b663-43ebff1340e4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:57.734502 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d66d64b2-4725-43a0-b663-43ebff1340e4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.165992 Jun 30 04:18:57.735075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 251/487] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:57 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:57.859309 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7a7b58ee-dd82-4a2b-8987-9a9a602b52b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:57.867339 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7a7b58ee-dd82-4a2b-8987-9a9a602b52b0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.157267 Jun 30 04:18:57.867927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 237/488] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:57 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:18:58.752046 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f828f1ad-c2b1-4e93-9386-e6249ca174a0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:58.752760 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f828f1ad-c2b1-4e93-9386-e6249ca174a0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:58.755129 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:18:58.761574 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f828f1ad-c2b1-4e93-9386-e6249ca174a0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:58.762013 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f828f1ad-c2b1-4e93-9386-e6249ca174a0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:58.762774 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f828f1ad-c2b1-4e93-9386-e6249ca174a0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:58.763268 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f828f1ad-c2b1-4e93-9386-e6249ca174a0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:58.885186 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5e5f521e-e6fd-4748-971c-31b4a543dcb3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:58.886479 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5e5f521e-e6fd-4748-971c-31b4a543dcb3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:58.893723 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e5f521e-e6fd-4748-971c-31b4a543dcb3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:58.893954 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f828f1ad-c2b1-4e93-9386-e6249ca174a0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:58.894139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e5f521e-e6fd-4748-971c-31b4a543dcb3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:58.895243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e5f521e-e6fd-4748-971c-31b4a543dcb3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:58.895835 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5e5f521e-e6fd-4748-971c-31b4a543dcb3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:58.902619 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f828f1ad-c2b1-4e93-9386-e6249ca174a0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.154501 Jun 30 04:18:58.913686 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 252/489] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:58 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:59.029825 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5e5f521e-e6fd-4748-971c-31b4a543dcb3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:18:59.038749 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5e5f521e-e6fd-4748-971c-31b4a543dcb3 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.157835 Jun 30 04:18:59.039418 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 238/490] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:58 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:18:59.920634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6c8e6130-047f-4b9d-93f2-e39ebe66e027 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:18:59.921328 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6c8e6130-047f-4b9d-93f2-e39ebe66e027 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:18:59.928246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c8e6130-047f-4b9d-93f2-e39ebe66e027 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:59.928690 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c8e6130-047f-4b9d-93f2-e39ebe66e027 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:18:59.929491 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c8e6130-047f-4b9d-93f2-e39ebe66e027 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:18:59.929922 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c8e6130-047f-4b9d-93f2-e39ebe66e027 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:00.057343 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3328e241-fd4e-4dda-a461-0862b78b7ee1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:00.057979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3328e241-fd4e-4dda-a461-0862b78b7ee1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:00.064940 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3328e241-fd4e-4dda-a461-0862b78b7ee1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:00.065386 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3328e241-fd4e-4dda-a461-0862b78b7ee1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:00.066044 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6c8e6130-047f-4b9d-93f2-e39ebe66e027 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:00.066511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3328e241-fd4e-4dda-a461-0862b78b7ee1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:00.067055 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3328e241-fd4e-4dda-a461-0862b78b7ee1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:00.075006 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6c8e6130-047f-4b9d-93f2-e39ebe66e027 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.158203 Jun 30 04:19:00.075634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 253/491] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:18:59 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:00.201942 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3328e241-fd4e-4dda-a461-0862b78b7ee1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:00.210036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3328e241-fd4e-4dda-a461-0862b78b7ee1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.156819 Jun 30 04:19:00.210645 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 239/492] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:00 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:01.092736 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-60e2c1cd-da51-41fb-bbc8-db490f667204 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:01.093435 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-60e2c1cd-da51-41fb-bbc8-db490f667204 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:01.100160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-60e2c1cd-da51-41fb-bbc8-db490f667204 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:01.100718 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-60e2c1cd-da51-41fb-bbc8-db490f667204 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:01.101727 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-60e2c1cd-da51-41fb-bbc8-db490f667204 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:01.102651 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-60e2c1cd-da51-41fb-bbc8-db490f667204 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:01.228353 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4a3c5731-6f90-4834-a9bc-3ba40322208c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:01.229863 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4a3c5731-6f90-4834-a9bc-3ba40322208c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:01.238241 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a3c5731-6f90-4834-a9bc-3ba40322208c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:01.238857 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a3c5731-6f90-4834-a9bc-3ba40322208c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:01.239923 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a3c5731-6f90-4834-a9bc-3ba40322208c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:01.240378 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a3c5731-6f90-4834-a9bc-3ba40322208c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:01.261580 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:01.574852 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-60e2c1cd-da51-41fb-bbc8-db490f667204 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:01.582764 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-60e2c1cd-da51-41fb-bbc8-db490f667204 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.494538 Jun 30 04:19:01.592897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 254/493] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:01 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:01.662529 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4a3c5731-6f90-4834-a9bc-3ba40322208c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:01.671133 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4a3c5731-6f90-4834-a9bc-3ba40322208c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.446531 Jun 30 04:19:01.671731 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 240/494] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:01 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:02.345836 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-e65d90af-8640-4bd8-97f8-c902a352100f req-68f21a97-152c-43f8-97c1-f9aad78d70e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51520645-cd99-466c-83b2-8f735e7d04cf", "tag": "9bba023e-b365-43ab-a64b-b1010d222f8a"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:02.357620 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-e65d90af-8640-4bd8-97f8-c902a352100f req-68f21a97-152c-43f8-97c1-f9aad78d70e7 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:02.358083 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-e65d90af-8640-4bd8-97f8-c902a352100f req-68f21a97-152c-43f8-97c1-f9aad78d70e7 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:02.383927 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-e65d90af-8640-4bd8-97f8-c902a352100f req-68f21a97-152c-43f8-97c1-f9aad78d70e7 service nova] Creating event network-changed:9bba023e-b365-43ab-a64b-b1010d222f8a for instance 51520645-cd99-466c-83b2-8f735e7d04cf on hv-cinder-84684 Jun 30 04:19:02.389459 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-e65d90af-8640-4bd8-97f8-c902a352100f req-68f21a97-152c-43f8-97c1-f9aad78d70e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047579 Jun 30 04:19:02.390742 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 255/495] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:02.601056 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bc709eb6-6885-4b1a-9a7b-c86a451754e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:02.601563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bc709eb6-6885-4b1a-9a7b-c86a451754e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:02.608744 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc709eb6-6885-4b1a-9a7b-c86a451754e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:02.609187 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc709eb6-6885-4b1a-9a7b-c86a451754e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:02.609925 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc709eb6-6885-4b1a-9a7b-c86a451754e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:02.610381 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc709eb6-6885-4b1a-9a7b-c86a451754e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:02.690018 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6b68f2e4-6b77-4f4f-9ff6-036be80172ba tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:02.690717 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6b68f2e4-6b77-4f4f-9ff6-036be80172ba tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:02.697785 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6b68f2e4-6b77-4f4f-9ff6-036be80172ba tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:02.698219 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6b68f2e4-6b77-4f4f-9ff6-036be80172ba tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:02.699014 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6b68f2e4-6b77-4f4f-9ff6-036be80172ba tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:02.699474 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6b68f2e4-6b77-4f4f-9ff6-036be80172ba tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:02.777714 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bc709eb6-6885-4b1a-9a7b-c86a451754e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:02.785474 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bc709eb6-6885-4b1a-9a7b-c86a451754e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.188542 Jun 30 04:19:02.786087 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 241/496] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:02 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:02.846097 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6b68f2e4-6b77-4f4f-9ff6-036be80172ba tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:02.854037 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6b68f2e4-6b77-4f4f-9ff6-036be80172ba tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.169328 Jun 30 04:19:02.854613 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 256/497] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:02 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:03.805925 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1459bbc8-7961-4253-910a-b84447754db2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:03.806897 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1459bbc8-7961-4253-910a-b84447754db2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:03.814934 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1459bbc8-7961-4253-910a-b84447754db2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:03.815422 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1459bbc8-7961-4253-910a-b84447754db2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:03.816209 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1459bbc8-7961-4253-910a-b84447754db2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:03.816654 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1459bbc8-7961-4253-910a-b84447754db2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:03.871326 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-dfe7295e-22ee-42e7-b202-ba367f917f9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:03.871871 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-dfe7295e-22ee-42e7-b202-ba367f917f9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:03.878836 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dfe7295e-22ee-42e7-b202-ba367f917f9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:03.879318 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dfe7295e-22ee-42e7-b202-ba367f917f9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:03.880065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dfe7295e-22ee-42e7-b202-ba367f917f9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:03.880486 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dfe7295e-22ee-42e7-b202-ba367f917f9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:03.884662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=100 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:04.244179 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1459bbc8-7961-4253-910a-b84447754db2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:04.250656 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-dfe7295e-22ee-42e7-b202-ba367f917f9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:04.252051 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1459bbc8-7961-4253-910a-b84447754db2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.452592 Jun 30 04:19:04.252638 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 242/498] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:03 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:04.258078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-dfe7295e-22ee-42e7-b202-ba367f917f9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.391201 Jun 30 04:19:04.258637 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 257/499] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:03 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:05.272175 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-501d110d-f192-4020-844f-973775677460 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:05.273134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-501d110d-f192-4020-844f-973775677460 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:05.276766 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-73e91964-34d9-45da-b76f-fb40a04177e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:05.277454 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-73e91964-34d9-45da-b76f-fb40a04177e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:05.281321 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501d110d-f192-4020-844f-973775677460 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:05.281763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501d110d-f192-4020-844f-973775677460 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:05.282521 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501d110d-f192-4020-844f-973775677460 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:05.282940 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501d110d-f192-4020-844f-973775677460 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:05.284502 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-73e91964-34d9-45da-b76f-fb40a04177e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:05.284954 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-73e91964-34d9-45da-b76f-fb40a04177e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:05.286042 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-73e91964-34d9-45da-b76f-fb40a04177e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:05.286478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-73e91964-34d9-45da-b76f-fb40a04177e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:05.479156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-501d110d-f192-4020-844f-973775677460 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:05.483734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-73e91964-34d9-45da-b76f-fb40a04177e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:05.487333 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-501d110d-f192-4020-844f-973775677460 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.220735 Jun 30 04:19:05.487915 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 243/500] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:05 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:05.491146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-73e91964-34d9-45da-b76f-fb40a04177e6 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.219489 Jun 30 04:19:05.491871 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 258/501] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:05 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:05.855905 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3ba1a366-7481-4f8c-8dfa-7b74dbcb51e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:05.856391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3ba1a366-7481-4f8c-8dfa-7b74dbcb51e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:05.863136 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ba1a366-7481-4f8c-8dfa-7b74dbcb51e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:05.863597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ba1a366-7481-4f8c-8dfa-7b74dbcb51e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:05.864345 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ba1a366-7481-4f8c-8dfa-7b74dbcb51e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:05.864772 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3ba1a366-7481-4f8c-8dfa-7b74dbcb51e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:05.896467 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3ba1a366-7481-4f8c-8dfa-7b74dbcb51e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments/3a17e55b-8778-4e39-821f-a8456a029b07" status: 200 len: 194 microversion: 2.20 time: 0.046987 Jun 30 04:19:05.897065 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 244/502] 10.222.0.13 () {60 vars in 1453 bytes} [Thu Jun 30 04:19:05 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments/3a17e55b-8778-4e39-821f-a8456a029b07 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:19:05.964312 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cfef9c21-8cef-4f47-9d7c-6c0c6d7a1980 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:05.964893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cfef9c21-8cef-4f47-9d7c-6c0c6d7a1980 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:05.971964 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cfef9c21-8cef-4f47-9d7c-6c0c6d7a1980 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:05.972402 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cfef9c21-8cef-4f47-9d7c-6c0c6d7a1980 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:05.973147 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cfef9c21-8cef-4f47-9d7c-6c0c6d7a1980 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:05.973570 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cfef9c21-8cef-4f47-9d7c-6c0c6d7a1980 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:06.074849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-cfef9c21-8cef-4f47-9d7c-6c0c6d7a1980 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lazy-loading 'services' on Instance uuid 2d3f3442-a00e-47ee-b0df-f099086628ce {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:19:06.157426 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cfef9c21-8cef-4f47-9d7c-6c0c6d7a1980 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments/3a17e55b-8778-4e39-821f-a8456a029b07" status: 202 len: 0 microversion: 2.20 time: 0.199277 Jun 30 04:19:06.158013 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 259/503] 10.222.0.13 () {60 vars in 1456 bytes} [Thu Jun 30 04:19:05 2022] DELETE /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments/3a17e55b-8778-4e39-821f-a8456a029b07 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:19:06.166532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-82518b80-d5fa-493b-bd91-b01b51cef485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:06.167482 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-82518b80-d5fa-493b-bd91-b01b51cef485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:06.173780 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82518b80-d5fa-493b-bd91-b01b51cef485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:06.174228 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82518b80-d5fa-493b-bd91-b01b51cef485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:06.174985 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82518b80-d5fa-493b-bd91-b01b51cef485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:06.175448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82518b80-d5fa-493b-bd91-b01b51cef485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:06.206608 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-82518b80-d5fa-493b-bd91-b01b51cef485 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044026 Jun 30 04:19:06.207212 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 245/504] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 30 04:19:06 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:19:06.506778 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-51dace3d-d65c-4e1a-a0aa-cf72a7754583 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:06.507385 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8116861e-feed-4cad-b10c-80ad41805843 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:06.507833 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-51dace3d-d65c-4e1a-a0aa-cf72a7754583 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:06.507966 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8116861e-feed-4cad-b10c-80ad41805843 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:06.514282 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51dace3d-d65c-4e1a-a0aa-cf72a7754583 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:06.514616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8116861e-feed-4cad-b10c-80ad41805843 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:06.514775 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51dace3d-d65c-4e1a-a0aa-cf72a7754583 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:06.515068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8116861e-feed-4cad-b10c-80ad41805843 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:06.515622 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51dace3d-d65c-4e1a-a0aa-cf72a7754583 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:06.515839 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8116861e-feed-4cad-b10c-80ad41805843 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:06.516056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51dace3d-d65c-4e1a-a0aa-cf72a7754583 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:06.516273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8116861e-feed-4cad-b10c-80ad41805843 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:06.790137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-51dace3d-d65c-4e1a-a0aa-cf72a7754583 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:06.801367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-51dace3d-d65c-4e1a-a0aa-cf72a7754583 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.299143 Jun 30 04:19:06.802209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 260/505] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:06 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:06.806528 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8116861e-feed-4cad-b10c-80ad41805843 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:06.816796 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8116861e-feed-4cad-b10c-80ad41805843 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.313459 Jun 30 04:19:06.817375 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 246/506] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:06 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:07.222869 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cf9aedd6-c13b-4d74-8abd-b69555378786 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:07.224508 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cf9aedd6-c13b-4d74-8abd-b69555378786 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:07.232871 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf9aedd6-c13b-4d74-8abd-b69555378786 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:07.233331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf9aedd6-c13b-4d74-8abd-b69555378786 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:07.234090 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf9aedd6-c13b-4d74-8abd-b69555378786 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:07.234543 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cf9aedd6-c13b-4d74-8abd-b69555378786 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:07.263982 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cf9aedd6-c13b-4d74-8abd-b69555378786 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047985 Jun 30 04:19:07.264521 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 261/507] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 30 04:19:07 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:19:07.820428 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e082f7ed-c6e7-4378-92c0-8d56568462e0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:07.821031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e082f7ed-c6e7-4378-92c0-8d56568462e0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:07.828108 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e082f7ed-c6e7-4378-92c0-8d56568462e0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:07.828815 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e082f7ed-c6e7-4378-92c0-8d56568462e0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:07.829314 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e082f7ed-c6e7-4378-92c0-8d56568462e0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:07.829758 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e082f7ed-c6e7-4378-92c0-8d56568462e0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:07.835007 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9d3ef796-7100-46a9-b1d8-3143ddd7df72 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:07.835007 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9d3ef796-7100-46a9-b1d8-3143ddd7df72 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:07.841452 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9d3ef796-7100-46a9-b1d8-3143ddd7df72 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:07.841895 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9d3ef796-7100-46a9-b1d8-3143ddd7df72 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:07.842633 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9d3ef796-7100-46a9-b1d8-3143ddd7df72 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:07.843057 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9d3ef796-7100-46a9-b1d8-3143ddd7df72 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:08.026255 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e082f7ed-c6e7-4378-92c0-8d56568462e0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:08.033924 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9d3ef796-7100-46a9-b1d8-3143ddd7df72 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:08.035007 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e082f7ed-c6e7-4378-92c0-8d56568462e0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.218518 Jun 30 04:19:08.035612 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 247/508] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:07 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:08.041783 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9d3ef796-7100-46a9-b1d8-3143ddd7df72 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.211838 Jun 30 04:19:08.042432 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 262/509] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:07 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:08.279881 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-61ae3d8c-5385-41fa-a023-6526776b3dde tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:08.281799 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-61ae3d8c-5385-41fa-a023-6526776b3dde tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:08.292570 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61ae3d8c-5385-41fa-a023-6526776b3dde tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:08.293018 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61ae3d8c-5385-41fa-a023-6526776b3dde tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:08.293872 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61ae3d8c-5385-41fa-a023-6526776b3dde tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:08.294308 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61ae3d8c-5385-41fa-a023-6526776b3dde tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:08.324741 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-61ae3d8c-5385-41fa-a023-6526776b3dde tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051827 Jun 30 04:19:08.325532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 248/510] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 30 04:19:08 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:19:09.056804 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9efe24f3-2bf0-4346-9215-b851191bd231 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:09.057779 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9efe24f3-2bf0-4346-9215-b851191bd231 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:09.062611 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-da5c7905-9881-4e27-87cb-60c7ab543d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:09.063669 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-da5c7905-9881-4e27-87cb-60c7ab543d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:09.069084 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9efe24f3-2bf0-4346-9215-b851191bd231 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:09.069836 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9efe24f3-2bf0-4346-9215-b851191bd231 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:09.071089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9efe24f3-2bf0-4346-9215-b851191bd231 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:09.071863 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9efe24f3-2bf0-4346-9215-b851191bd231 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:09.074059 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da5c7905-9881-4e27-87cb-60c7ab543d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:09.074789 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da5c7905-9881-4e27-87cb-60c7ab543d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:09.075491 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da5c7905-9881-4e27-87cb-60c7ab543d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:09.075916 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-da5c7905-9881-4e27-87cb-60c7ab543d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:09.267011 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9efe24f3-2bf0-4346-9215-b851191bd231 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:09.271378 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-da5c7905-9881-4e27-87cb-60c7ab543d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:09.275069 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9efe24f3-2bf0-4346-9215-b851191bd231 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.224814 Jun 30 04:19:09.275697 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 263/511] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:09 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:09.279914 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-da5c7905-9881-4e27-87cb-60c7ab543d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.223728 Jun 30 04:19:09.280849 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 249/512] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:09 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:09.337569 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-2c79bcc0-91f8-4540-9e99-1d0bb9de1c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:09.338573 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-2c79bcc0-91f8-4540-9e99-1d0bb9de1c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:09.345115 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2c79bcc0-91f8-4540-9e99-1d0bb9de1c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:09.345563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2c79bcc0-91f8-4540-9e99-1d0bb9de1c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:09.346313 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2c79bcc0-91f8-4540-9e99-1d0bb9de1c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:09.346746 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2c79bcc0-91f8-4540-9e99-1d0bb9de1c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:09.376819 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-2c79bcc0-91f8-4540-9e99-1d0bb9de1c4e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043040 Jun 30 04:19:09.377304 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 264/513] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 30 04:19:09 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:19:10.292551 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5aefb8a2-883b-42fd-948a-ddf16a261146 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:10.293578 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5aefb8a2-883b-42fd-948a-ddf16a261146 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:10.299044 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9ac16aa6-9922-41cc-af3d-1d2678943292 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:10.299717 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9ac16aa6-9922-41cc-af3d-1d2678943292 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:10.300934 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5aefb8a2-883b-42fd-948a-ddf16a261146 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:10.301381 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5aefb8a2-883b-42fd-948a-ddf16a261146 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:10.302149 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5aefb8a2-883b-42fd-948a-ddf16a261146 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:10.302578 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5aefb8a2-883b-42fd-948a-ddf16a261146 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:10.315277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9ac16aa6-9922-41cc-af3d-1d2678943292 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:10.315727 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9ac16aa6-9922-41cc-af3d-1d2678943292 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:10.316514 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9ac16aa6-9922-41cc-af3d-1d2678943292 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:10.316943 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9ac16aa6-9922-41cc-af3d-1d2678943292 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:10.511545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5aefb8a2-883b-42fd-948a-ddf16a261146 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:10.514794 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9ac16aa6-9922-41cc-af3d-1d2678943292 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:10.520695 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5aefb8a2-883b-42fd-948a-ddf16a261146 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.232184 Jun 30 04:19:10.521689 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 250/514] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:10 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:10.522331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9ac16aa6-9922-41cc-af3d-1d2678943292 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.229033 Jun 30 04:19:10.523057 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 265/515] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:10 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:10.528601 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-896f37bb-f16b-40ff-966e-fd9507f2ec7c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:10.529754 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-896f37bb-f16b-40ff-966e-fd9507f2ec7c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:10.537111 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-896f37bb-f16b-40ff-966e-fd9507f2ec7c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:10.537655 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-896f37bb-f16b-40ff-966e-fd9507f2ec7c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:10.538483 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-896f37bb-f16b-40ff-966e-fd9507f2ec7c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:10.538982 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-896f37bb-f16b-40ff-966e-fd9507f2ec7c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:10.571577 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-896f37bb-f16b-40ff-966e-fd9507f2ec7c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048154 Jun 30 04:19:10.576552 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 251/516] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 30 04:19:10 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:19:11.542169 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bb4ed3ff-86ef-4d8c-a9a9-88f294820f8b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:11.543081 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-bb4ed3ff-86ef-4d8c-a9a9-88f294820f8b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:11.544058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6fefa56a-21fe-4205-ba58-e8858e094c8b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:11.545481 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6fefa56a-21fe-4205-ba58-e8858e094c8b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:11.555350 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bb4ed3ff-86ef-4d8c-a9a9-88f294820f8b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:11.556079 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bb4ed3ff-86ef-4d8c-a9a9-88f294820f8b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:11.556483 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6fefa56a-21fe-4205-ba58-e8858e094c8b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:11.557197 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6fefa56a-21fe-4205-ba58-e8858e094c8b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:11.557480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bb4ed3ff-86ef-4d8c-a9a9-88f294820f8b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:11.558026 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bb4ed3ff-86ef-4d8c-a9a9-88f294820f8b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:11.558471 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6fefa56a-21fe-4205-ba58-e8858e094c8b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:11.559171 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6fefa56a-21fe-4205-ba58-e8858e094c8b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:11.751909 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6fefa56a-21fe-4205-ba58-e8858e094c8b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:11.762058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6fefa56a-21fe-4205-ba58-e8858e094c8b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.224593 Jun 30 04:19:11.763359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 252/517] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:11 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:11.767020 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-bb4ed3ff-86ef-4d8c-a9a9-88f294820f8b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:11.774763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bb4ed3ff-86ef-4d8c-a9a9-88f294820f8b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.239451 Jun 30 04:19:11.775459 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 266/518] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:11 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:11.785050 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-514e57a2-d801-4791-950d-f4ea23444bbb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:11.785050 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-514e57a2-d801-4791-950d-f4ea23444bbb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:11.785291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-514e57a2-d801-4791-950d-f4ea23444bbb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:11.785675 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-514e57a2-d801-4791-950d-f4ea23444bbb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:11.786426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-514e57a2-d801-4791-950d-f4ea23444bbb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:11.786898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-514e57a2-d801-4791-950d-f4ea23444bbb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:11.817250 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-514e57a2-d801-4791-950d-f4ea23444bbb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043953 Jun 30 04:19:11.817723 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 253/519] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 30 04:19:11 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:19:11.869425 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-67191042-be17-49d0-821b-bf9228f7ebb4 req-2b1ebb91-3f5a-4506-a812-1ac20003d743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99", "name": "network-vif-plugged", "status": "completed", "tag": "2a4fd84e-fb19-4d1c-b772-2251c8322151"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:11.880686 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-67191042-be17-49d0-821b-bf9228f7ebb4 req-2b1ebb91-3f5a-4506-a812-1ac20003d743 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:11.881478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-67191042-be17-49d0-821b-bf9228f7ebb4 req-2b1ebb91-3f5a-4506-a812-1ac20003d743 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:11.898602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-67191042-be17-49d0-821b-bf9228f7ebb4 req-2b1ebb91-3f5a-4506-a812-1ac20003d743 service nova] Creating event network-vif-plugged:2a4fd84e-fb19-4d1c-b772-2251c8322151 for instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 on hv-cinder-84684 Jun 30 04:19:11.904282 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-67191042-be17-49d0-821b-bf9228f7ebb4 req-2b1ebb91-3f5a-4506-a812-1ac20003d743 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040412 Jun 30 04:19:11.905808 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 267/520] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:12.780883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-41b3c227-fd4a-422c-a582-62dc7c98c973 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:12.781469 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-41b3c227-fd4a-422c-a582-62dc7c98c973 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:12.788756 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-41b3c227-fd4a-422c-a582-62dc7c98c973 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:12.789226 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-41b3c227-fd4a-422c-a582-62dc7c98c973 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:12.790187 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-41b3c227-fd4a-422c-a582-62dc7c98c973 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:12.790714 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-41b3c227-fd4a-422c-a582-62dc7c98c973 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:12.793186 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-df7025f0-f740-4e2a-b0b0-82eacffd245f tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:12.794098 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-df7025f0-f740-4e2a-b0b0-82eacffd245f tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:12.801849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df7025f0-f740-4e2a-b0b0-82eacffd245f tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:12.802362 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df7025f0-f740-4e2a-b0b0-82eacffd245f tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:12.803281 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df7025f0-f740-4e2a-b0b0-82eacffd245f tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:12.803777 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df7025f0-f740-4e2a-b0b0-82eacffd245f tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:12.996218 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-41b3c227-fd4a-422c-a582-62dc7c98c973 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:12.999517 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-df7025f0-f740-4e2a-b0b0-82eacffd245f tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:13.005150 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-41b3c227-fd4a-422c-a582-62dc7c98c973 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.229156 Jun 30 04:19:13.005701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 254/521] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:12 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:13.007719 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-df7025f0-f740-4e2a-b0b0-82eacffd245f tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.219361 Jun 30 04:19:13.008288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 268/522] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:12 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:13.018403 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f479f4ae-36a1-46cb-abe2-d3967b13688c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:13.019322 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f479f4ae-36a1-46cb-abe2-d3967b13688c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:13.025562 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f479f4ae-36a1-46cb-abe2-d3967b13688c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:13.026031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f479f4ae-36a1-46cb-abe2-d3967b13688c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:13.026784 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f479f4ae-36a1-46cb-abe2-d3967b13688c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:13.027251 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f479f4ae-36a1-46cb-abe2-d3967b13688c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:13.057070 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f479f4ae-36a1-46cb-abe2-d3967b13688c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042714 Jun 30 04:19:13.057652 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 255/523] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 30 04:19:13 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:13.115676 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-143bb917-1a86-45f0-ae17-95b19ca481af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:13.116165 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-143bb917-1a86-45f0-ae17-95b19ca481af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:13.122512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-143bb917-1a86-45f0-ae17-95b19ca481af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:13.123203 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-143bb917-1a86-45f0-ae17-95b19ca481af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:13.123865 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-143bb917-1a86-45f0-ae17-95b19ca481af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:13.124075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-143bb917-1a86-45f0-ae17-95b19ca481af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:13.148818 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-143bb917-1a86-45f0-ae17-95b19ca481af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:19:13.227316 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-143bb917-1a86-45f0-ae17-95b19ca481af tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 204 len: 0 microversion: 2.20 time: 0.115211 Jun 30 04:19:13.228040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 269/524] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 30 04:19:13 2022] DELETE /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 04:19:13.237310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7518b80-7a1b-4428-80bb-f7221d0a2eb3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:13.237931 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a7518b80-7a1b-4428-80bb-f7221d0a2eb3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:13.244662 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7518b80-7a1b-4428-80bb-f7221d0a2eb3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:13.245101 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7518b80-7a1b-4428-80bb-f7221d0a2eb3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:13.245840 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7518b80-7a1b-4428-80bb-f7221d0a2eb3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:13.246265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7518b80-7a1b-4428-80bb-f7221d0a2eb3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:13.416076 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a7518b80-7a1b-4428-80bb-f7221d0a2eb3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:13.424280 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a7518b80-7a1b-4428-80bb-f7221d0a2eb3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:13.425782 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a7518b80-7a1b-4428-80bb-f7221d0a2eb3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:13.426939 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a7518b80-7a1b-4428-80bb-f7221d0a2eb3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.193610 Jun 30 04:19:13.427622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 256/525] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:13 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:13.858645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-95edcf37-c502-4a79-85ee-e267613d14e0 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:13.859367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-95edcf37-c502-4a79-85ee-e267613d14e0 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:13.867128 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-95edcf37-c502-4a79-85ee-e267613d14e0 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:13.867589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-95edcf37-c502-4a79-85ee-e267613d14e0 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:13.868358 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-95edcf37-c502-4a79-85ee-e267613d14e0 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:13.868791 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-95edcf37-c502-4a79-85ee-e267613d14e0 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:13.955782 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-95edcf37-c502-4a79-85ee-e267613d14e0 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lazy-loading 'services' on Instance uuid eef409b2-233a-4846-8e69-31ba8d23f79a {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:19:14.022307 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-218ccb54-7b0c-4e9a-bd14-fb9501877679 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:14.023481 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-218ccb54-7b0c-4e9a-bd14-fb9501877679 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:14.029772 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-95edcf37-c502-4a79-85ee-e267613d14e0 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a/os-volume_attachments/aefb6a60-0c9e-418b-b808-396c7bf4c06f" status: 202 len: 0 microversion: 2.1 time: 0.175281 Jun 30 04:19:14.030927 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 270/526] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:19:13 2022] DELETE /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a/os-volume_attachments/aefb6a60-0c9e-418b-b808-396c7bf4c06f => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:19:14.032281 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-218ccb54-7b0c-4e9a-bd14-fb9501877679 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:14.032728 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-218ccb54-7b0c-4e9a-bd14-fb9501877679 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:14.033489 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-218ccb54-7b0c-4e9a-bd14-fb9501877679 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:14.034189 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-218ccb54-7b0c-4e9a-bd14-fb9501877679 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:14.035829 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b44c7abe-e7e0-48aa-925f-698b0b2cd7e1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:14.036523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b44c7abe-e7e0-48aa-925f-698b0b2cd7e1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:14.038608 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:14.044413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b44c7abe-e7e0-48aa-925f-698b0b2cd7e1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:14.044927 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b44c7abe-e7e0-48aa-925f-698b0b2cd7e1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:14.045692 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b44c7abe-e7e0-48aa-925f-698b0b2cd7e1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:14.046130 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b44c7abe-e7e0-48aa-925f-698b0b2cd7e1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:14.066767 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:14.243504 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-218ccb54-7b0c-4e9a-bd14-fb9501877679 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:14.250663 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b44c7abe-e7e0-48aa-925f-698b0b2cd7e1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:14.251020 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-218ccb54-7b0c-4e9a-bd14-fb9501877679 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1371 microversion: 2.1 time: 0.233112 Jun 30 04:19:14.251623 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 257/527] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:14 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:19:14.262301 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b44c7abe-e7e0-48aa-925f-698b0b2cd7e1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.230397 Jun 30 04:19:14.262866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 271/528] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:14 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:14.453965 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2a8debc4-7e97-4ab7-a8e8-b9a78704cb41 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:14.454701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2a8debc4-7e97-4ab7-a8e8-b9a78704cb41 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:14.461342 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a8debc4-7e97-4ab7-a8e8-b9a78704cb41 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:14.461784 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a8debc4-7e97-4ab7-a8e8-b9a78704cb41 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:14.462537 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a8debc4-7e97-4ab7-a8e8-b9a78704cb41 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:14.462966 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a8debc4-7e97-4ab7-a8e8-b9a78704cb41 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:14.601785 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2a8debc4-7e97-4ab7-a8e8-b9a78704cb41 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:14.610196 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2a8debc4-7e97-4ab7-a8e8-b9a78704cb41 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:14.611775 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2a8debc4-7e97-4ab7-a8e8-b9a78704cb41 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:14.612933 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2a8debc4-7e97-4ab7-a8e8-b9a78704cb41 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.163878 Jun 30 04:19:14.613504 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 258/529] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:14 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:15.268467 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cc92bbd0-0df9-4d3d-b91f-cba569c794a2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:15.269046 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cc92bbd0-0df9-4d3d-b91f-cba569c794a2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:15.276532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cc92bbd0-0df9-4d3d-b91f-cba569c794a2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:15.277004 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cc92bbd0-0df9-4d3d-b91f-cba569c794a2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:15.277796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cc92bbd0-0df9-4d3d-b91f-cba569c794a2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:15.278229 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cc92bbd0-0df9-4d3d-b91f-cba569c794a2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:15.279289 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a9812efc-d312-409c-bef4-e6d2e9f1917a tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:15.280311 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a9812efc-d312-409c-bef4-e6d2e9f1917a tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:15.286296 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9812efc-d312-409c-bef4-e6d2e9f1917a tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:15.286812 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9812efc-d312-409c-bef4-e6d2e9f1917a tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:15.293030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9812efc-d312-409c-bef4-e6d2e9f1917a tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:15.293483 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9812efc-d312-409c-bef4-e6d2e9f1917a tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:15.487121 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cc92bbd0-0df9-4d3d-b91f-cba569c794a2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:15.491240 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a9812efc-d312-409c-bef4-e6d2e9f1917a tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:15.494827 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cc92bbd0-0df9-4d3d-b91f-cba569c794a2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1566 microversion: 2.1 time: 0.230269 Jun 30 04:19:15.495646 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 272/530] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:15 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:15.499480 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a9812efc-d312-409c-bef4-e6d2e9f1917a tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.223994 Jun 30 04:19:15.500083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 259/531] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:15 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:15.511590 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ddebe274-a8f7-48ef-8df8-fed0dbf7ecac tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:15.512110 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ddebe274-a8f7-48ef-8df8-fed0dbf7ecac tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:15.518285 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ddebe274-a8f7-48ef-8df8-fed0dbf7ecac tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:15.518734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ddebe274-a8f7-48ef-8df8-fed0dbf7ecac tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:15.519559 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ddebe274-a8f7-48ef-8df8-fed0dbf7ecac tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:15.519988 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ddebe274-a8f7-48ef-8df8-fed0dbf7ecac tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:15.599203 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ddebe274-a8f7-48ef-8df8-fed0dbf7ecac tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091334 Jun 30 04:19:15.599833 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 273/532] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 30 04:19:15 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:15.631469 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-75d01b7f-5088-4272-810c-c62fb34f25b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:15.632184 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-75d01b7f-5088-4272-810c-c62fb34f25b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:15.638964 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-75d01b7f-5088-4272-810c-c62fb34f25b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:15.639459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-75d01b7f-5088-4272-810c-c62fb34f25b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:15.640229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-75d01b7f-5088-4272-810c-c62fb34f25b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:15.640640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-75d01b7f-5088-4272-810c-c62fb34f25b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:15.889946 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-d08ce2d5-2a18-4f76-8c90-3c5fb7efa139 req-7e40054c-3833-4a6b-b797-78ef6253d054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51520645-cd99-466c-83b2-8f735e7d04cf", "name": "network-vif-plugged", "status": "completed", "tag": "9bba023e-b365-43ab-a64b-b1010d222f8a"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:15.899513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-d08ce2d5-2a18-4f76-8c90-3c5fb7efa139 req-7e40054c-3833-4a6b-b797-78ef6253d054 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:15.900055 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-d08ce2d5-2a18-4f76-8c90-3c5fb7efa139 req-7e40054c-3833-4a6b-b797-78ef6253d054 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:15.915235 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-d08ce2d5-2a18-4f76-8c90-3c5fb7efa139 req-7e40054c-3833-4a6b-b797-78ef6253d054 service nova] Creating event network-vif-plugged:9bba023e-b365-43ab-a64b-b1010d222f8a for instance 51520645-cd99-466c-83b2-8f735e7d04cf on hv-cinder-84684 Jun 30 04:19:15.919942 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-75d01b7f-5088-4272-810c-c62fb34f25b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:15.921454 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-d08ce2d5-2a18-4f76-8c90-3c5fb7efa139 req-7e40054c-3833-4a6b-b797-78ef6253d054 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035573 Jun 30 04:19:15.928168 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-75d01b7f-5088-4272-810c-c62fb34f25b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:15.928599 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 274/533] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:15.929998 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-75d01b7f-5088-4272-810c-c62fb34f25b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:15.941824 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-75d01b7f-5088-4272-810c-c62fb34f25b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.314193 Jun 30 04:19:15.956297 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 260/534] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:15 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:16.518067 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3a4a5867-a78b-46ca-9877-3a507493b7b5 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:16.518740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3a4a5867-a78b-46ca-9877-3a507493b7b5 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:16.525420 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3a4a5867-a78b-46ca-9877-3a507493b7b5 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:16.525832 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3a4a5867-a78b-46ca-9877-3a507493b7b5 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:16.526797 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3a4a5867-a78b-46ca-9877-3a507493b7b5 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:16.527272 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3a4a5867-a78b-46ca-9877-3a507493b7b5 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:16.961242 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-15982209-642b-41b5-a3d0-100b5415b8ec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:16.961853 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-15982209-642b-41b5-a3d0-100b5415b8ec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:16.969035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-15982209-642b-41b5-a3d0-100b5415b8ec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:16.969481 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-15982209-642b-41b5-a3d0-100b5415b8ec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:16.970239 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-15982209-642b-41b5-a3d0-100b5415b8ec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:16.970638 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-15982209-642b-41b5-a3d0-100b5415b8ec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:17.099427 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3a4a5867-a78b-46ca-9877-3a507493b7b5 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:17.107820 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3a4a5867-a78b-46ca-9877-3a507493b7b5 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.594684 Jun 30 04:19:17.108400 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 275/535] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:16 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:17.266729 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a7546df1-e669-43ed-a76b-ec72241fa56d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:17.267147 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a7546df1-e669-43ed-a76b-ec72241fa56d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:17.273394 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a7546df1-e669-43ed-a76b-ec72241fa56d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:17.273837 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a7546df1-e669-43ed-a76b-ec72241fa56d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:17.274589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a7546df1-e669-43ed-a76b-ec72241fa56d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:17.275017 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a7546df1-e669-43ed-a76b-ec72241fa56d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:17.301142 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a7546df1-e669-43ed-a76b-ec72241fa56d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:19:17.381302 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a7546df1-e669-43ed-a76b-ec72241fa56d tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 204 len: 0 microversion: 2.1 time: 0.118725 Jun 30 04:19:17.381986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 276/536] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:19:17 2022] DELETE /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:19:17.390707 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b1751bd2-8d67-4db5-9ea0-f0086e0c8f82 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:17.391441 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b1751bd2-8d67-4db5-9ea0-f0086e0c8f82 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:17.397795 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b1751bd2-8d67-4db5-9ea0-f0086e0c8f82 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:17.398372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b1751bd2-8d67-4db5-9ea0-f0086e0c8f82 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:17.399203 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b1751bd2-8d67-4db5-9ea0-f0086e0c8f82 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:17.399760 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b1751bd2-8d67-4db5-9ea0-f0086e0c8f82 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:17.767913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-15982209-642b-41b5-a3d0-100b5415b8ec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:17.776330 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-15982209-642b-41b5-a3d0-100b5415b8ec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:17.777813 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-15982209-642b-41b5-a3d0-100b5415b8ec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:17.779056 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-15982209-642b-41b5-a3d0-100b5415b8ec tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1724 microversion: 2.20 time: 0.821970 Jun 30 04:19:17.780550 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 261/537] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:16 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1724 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:19:17.970613 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b1751bd2-8d67-4db5-9ea0-f0086e0c8f82 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:17.979129 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b1751bd2-8d67-4db5-9ea0-f0086e0c8f82 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1514 microversion: 2.1 time: 0.592674 Jun 30 04:19:17.979738 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 277/538] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:17 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1514 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:19:18.124272 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d2bad2d9-6654-4f8b-af38-7fc0befc2a01 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:18.124866 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d2bad2d9-6654-4f8b-af38-7fc0befc2a01 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:18.131629 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2bad2d9-6654-4f8b-af38-7fc0befc2a01 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:18.132079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2bad2d9-6654-4f8b-af38-7fc0befc2a01 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:18.132841 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2bad2d9-6654-4f8b-af38-7fc0befc2a01 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:18.133271 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2bad2d9-6654-4f8b-af38-7fc0befc2a01 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:18.386521 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-ed55ceff-4e53-4aba-ba90-5530c05ca33d req-c2ac6554-8aee-46d4-a457-77946c83c588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99", "tag": "2a4fd84e-fb19-4d1c-b772-2251c8322151"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:18.395708 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-ed55ceff-4e53-4aba-ba90-5530c05ca33d req-c2ac6554-8aee-46d4-a457-77946c83c588 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:18.396435 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-ed55ceff-4e53-4aba-ba90-5530c05ca33d req-c2ac6554-8aee-46d4-a457-77946c83c588 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:18.411615 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d2bad2d9-6654-4f8b-af38-7fc0befc2a01 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:18.423590 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d2bad2d9-6654-4f8b-af38-7fc0befc2a01 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1358 microversion: 2.1 time: 0.303175 Jun 30 04:19:18.424182 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 262/539] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:18 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:18.425383 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-ed55ceff-4e53-4aba-ba90-5530c05ca33d req-c2ac6554-8aee-46d4-a457-77946c83c588 service nova] Creating event network-changed:2a4fd84e-fb19-4d1c-b772-2251c8322151 for instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 on hv-cinder-84684 Jun 30 04:19:18.430879 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-ed55ceff-4e53-4aba-ba90-5530c05ca33d req-c2ac6554-8aee-46d4-a457-77946c83c588 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048269 Jun 30 04:19:18.431803 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 278/540] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:18.798893 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4a6a6031-b25e-438e-8190-18a9d206362a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:18.799450 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4a6a6031-b25e-438e-8190-18a9d206362a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:18.807659 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=70 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:18.809844 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a6a6031-b25e-438e-8190-18a9d206362a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:18.810567 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a6a6031-b25e-438e-8190-18a9d206362a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:18.812094 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a6a6031-b25e-438e-8190-18a9d206362a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:18.812540 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a6a6031-b25e-438e-8190-18a9d206362a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:18.883254 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4a6a6031-b25e-438e-8190-18a9d206362a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:18.894159 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4a6a6031-b25e-438e-8190-18a9d206362a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:18.896580 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4a6a6031-b25e-438e-8190-18a9d206362a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:18.897972 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4a6a6031-b25e-438e-8190-18a9d206362a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1656 microversion: 2.20 time: 0.103862 Jun 30 04:19:18.898729 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 263/541] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:18 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1656 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:18.999625 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a81930d9-8099-4a13-9748-88c393d56080 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:19.001512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a81930d9-8099-4a13-9748-88c393d56080 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:19.011430 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a81930d9-8099-4a13-9748-88c393d56080 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:19.012099 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a81930d9-8099-4a13-9748-88c393d56080 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:19.013048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a81930d9-8099-4a13-9748-88c393d56080 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:19.013674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a81930d9-8099-4a13-9748-88c393d56080 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:19.170928 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a81930d9-8099-4a13-9748-88c393d56080 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:19.180174 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a81930d9-8099-4a13-9748-88c393d56080 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1514 microversion: 2.1 time: 0.186963 Jun 30 04:19:19.181232 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 279/542] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:18 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:19.441721 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fef6c1ce-b04b-454d-80da-9e10041a546d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:19.443273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fef6c1ce-b04b-454d-80da-9e10041a546d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:19.451883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fef6c1ce-b04b-454d-80da-9e10041a546d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:19.453371 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fef6c1ce-b04b-454d-80da-9e10041a546d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:19.454720 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fef6c1ce-b04b-454d-80da-9e10041a546d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:19.455393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fef6c1ce-b04b-454d-80da-9e10041a546d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:19.611710 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fef6c1ce-b04b-454d-80da-9e10041a546d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:19.620267 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fef6c1ce-b04b-454d-80da-9e10041a546d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1548 microversion: 2.1 time: 0.182859 Jun 30 04:19:19.621162 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 264/543] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:19 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:19.637818 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ca2743df-77d9-4249-8bc8-5fced726d272 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:19.639152 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ca2743df-77d9-4249-8bc8-5fced726d272 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:19.645354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca2743df-77d9-4249-8bc8-5fced726d272 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:19.645795 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca2743df-77d9-4249-8bc8-5fced726d272 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:19.646542 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca2743df-77d9-4249-8bc8-5fced726d272 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:19.646964 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca2743df-77d9-4249-8bc8-5fced726d272 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:19.792535 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ca2743df-77d9-4249-8bc8-5fced726d272 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:19.800938 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ca2743df-77d9-4249-8bc8-5fced726d272 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1548 microversion: 2.1 time: 0.166820 Jun 30 04:19:19.801521 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 280/544] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:19 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:19.817157 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a0db2eb1-a255-46b2-9301-07d4873e3f48 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:19.820708 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a0db2eb1-a255-46b2-9301-07d4873e3f48 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:19.821371 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a0db2eb1-a255-46b2-9301-07d4873e3f48 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Searching by: {'deleted': False, 'project_id': 'bf207393082c48d09f827e16d99b2609'} {{(pid=118187) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 30 04:19:19.828415 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0db2eb1-a255-46b2-9301-07d4873e3f48 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:19.828862 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0db2eb1-a255-46b2-9301-07d4873e3f48 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:19.829660 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0db2eb1-a255-46b2-9301-07d4873e3f48 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:19.830094 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0db2eb1-a255-46b2-9301-07d4873e3f48 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:19.917284 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5ebe9cb8-24cb-4dde-b9a5-0292d69a11d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:19.917913 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5ebe9cb8-24cb-4dde-b9a5-0292d69a11d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:19.920765 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.multi_cell_list [None req-a0db2eb1-a255-46b2-9301-07d4873e3f48 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118187) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 30 04:19:19.924853 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5ebe9cb8-24cb-4dde-b9a5-0292d69a11d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:19.925503 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5ebe9cb8-24cb-4dde-b9a5-0292d69a11d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:19.926320 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5ebe9cb8-24cb-4dde-b9a5-0292d69a11d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:19.926811 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5ebe9cb8-24cb-4dde-b9a5-0292d69a11d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:19.990971 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5ebe9cb8-24cb-4dde-b9a5-0292d69a11d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:20.000110 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5ebe9cb8-24cb-4dde-b9a5-0292d69a11d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:20.003394 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5ebe9cb8-24cb-4dde-b9a5-0292d69a11d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:20.004816 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5ebe9cb8-24cb-4dde-b9a5-0292d69a11d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 200 len: 1367 microversion: 2.20 time: 0.092344 Jun 30 04:19:20.005516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 281/545] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:19 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:20.017119 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a0db2eb1-a255-46b2-9301-07d4873e3f48 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203910 Jun 30 04:19:20.017702 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 265/546] 10.222.0.13 () {58 vars in 1124 bytes} [Thu Jun 30 04:19:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:20.028568 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f33ecfa9-572f-43f6-8214-23e5b41ca596 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:20.030260 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f33ecfa9-572f-43f6-8214-23e5b41ca596 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:20.041257 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f33ecfa9-572f-43f6-8214-23e5b41ca596 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:20.042110 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f33ecfa9-572f-43f6-8214-23e5b41ca596 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:20.043691 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f33ecfa9-572f-43f6-8214-23e5b41ca596 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:20.044281 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f33ecfa9-572f-43f6-8214-23e5b41ca596 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:20.199304 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-651b59c0-b9b2-4466-9592-dce002fb8a24 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:20.199826 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-651b59c0-b9b2-4466-9592-dce002fb8a24 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:20.207933 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-651b59c0-b9b2-4466-9592-dce002fb8a24 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:20.208693 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-651b59c0-b9b2-4466-9592-dce002fb8a24 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:20.209551 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-651b59c0-b9b2-4466-9592-dce002fb8a24 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:20.210068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-651b59c0-b9b2-4466-9592-dce002fb8a24 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:20.315360 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f33ecfa9-572f-43f6-8214-23e5b41ca596 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:20.326000 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f33ecfa9-572f-43f6-8214-23e5b41ca596 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1548 microversion: 2.1 time: 0.301884 Jun 30 04:19:20.327329 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 282/547] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:20 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1548 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:19:20.480059 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-17adeb5f-5512-4650-89b1-91d6dc4dc2e3 req-bcb67fc3-df37-4a85-a07c-554f478f12a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3f3442-a00e-47ee-b0df-f099086628ce", "name": "network-vif-deleted", "tag": "bd404336-185f-4a39-8576-5211044a2340"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:20.488943 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-651b59c0-b9b2-4466-9592-dce002fb8a24 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:20.489499 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-17adeb5f-5512-4650-89b1-91d6dc4dc2e3 req-bcb67fc3-df37-4a85-a07c-554f478f12a5 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:20.489826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-17adeb5f-5512-4650-89b1-91d6dc4dc2e3 req-bcb67fc3-df37-4a85-a07c-554f478f12a5 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:20.500002 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-651b59c0-b9b2-4466-9592-dce002fb8a24 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1514 microversion: 2.1 time: 0.305027 Jun 30 04:19:20.500601 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 266/548] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:20 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:19:20.511220 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-17adeb5f-5512-4650-89b1-91d6dc4dc2e3 req-bcb67fc3-df37-4a85-a07c-554f478f12a5 service nova] Creating event network-vif-deleted:bd404336-185f-4a39-8576-5211044a2340 for instance 2d3f3442-a00e-47ee-b0df-f099086628ce on hv-cinder-84684 Jun 30 04:19:20.517559 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-17adeb5f-5512-4650-89b1-91d6dc4dc2e3 req-bcb67fc3-df37-4a85-a07c-554f478f12a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040774 Jun 30 04:19:20.523528 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 283/549] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:21.024619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fb341497-35f6-419f-918f-a19af7d234b6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:21.025239 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fb341497-35f6-419f-918f-a19af7d234b6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:21.032454 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb341497-35f6-419f-918f-a19af7d234b6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:21.032837 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb341497-35f6-419f-918f-a19af7d234b6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:21.033606 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb341497-35f6-419f-918f-a19af7d234b6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:21.034038 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb341497-35f6-419f-918f-a19af7d234b6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:21.048959 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-fb341497-35f6-419f-918f-a19af7d234b6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] HTTP exception thrown: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fb341497-35f6-419f-918f-a19af7d234b6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Request method failure captured: Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce HTTP/1.1 Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSNQsk-6X430AgxlsYMK_xfgXD3QIR_YcGcLOc1F0bJAYe-GGII0D15StDWufPR7AXMaOrCfvhzCpOLegukGTCu8dmpB09FRdEWy4XTxeXBWhLqEf7sQpqkN4vCCqYZJS4WsUsAIpzEKwKdkp7_EPQmRC9TM9ieBWyB8d8z61ssPEl8 Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:19:21.050771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71588f8a5fc34919a77f28b6a8c8db0e"}]}] Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: 8e3bc7e015f5419aa956568707764f67 Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:19:21.052628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '2d3f3442-a00e-47ee-b0df-f099086628ce'} Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:19:21.053704 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:19:21.055621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:19:21.057167 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fb341497-35f6-419f-918f-a19af7d234b6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Returning 404 to user: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:19:21.057167 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fb341497-35f6-419f-918f-a19af7d234b6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 404 len: 111 microversion: 2.20 time: 0.032566 Jun 30 04:19:21.057167 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 267/550] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:21 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 04:19:21.064185 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8676e1ad-65ef-4eec-8705-144d09caf81e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '.version_select at 0x7fb4802499d0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:21.089281 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8676e1ad-65ef-4eec-8705-144d09caf81e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702144774" status: 204 len: 0 microversion: 2.20 time: 0.030411 Jun 30 04:19:21.095114 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 284/551] 10.222.0.13 () {60 vars in 1261 bytes} [Thu Jun 30 04:19:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702144774 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 04:19:21.516949 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:21.517535 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:21.524560 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:21.525073 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:21.525770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:21.526222 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:21.559545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:21.560174 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:21.561160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lazy-loading 'fault' on Instance uuid eef409b2-233a-4846-8e69-31ba8d23f79a {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:19:21.613973 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfd09ef27184291a36b43b6664740c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5e183a36084c9fb82f3a3f7d24402a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:21.622595 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d3c98a0f-5083-43ff-9daf-30d7c9180cf8 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 200 len: 1309 microversion: 2.1 time: 0.109575 Jun 30 04:19:21.624943 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 268/552] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:21 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:21.824906 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-89238026-de30-48a1-9a8e-f5aa09679e81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Action: 'create', calling method: .version_select at 0x7fb48047ed30>, body: {"keypair": {"name": "tempest-keypair-1988349919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkVkioBvS46FAVaoQe9Z37uiYyP2yiAAEdo3MFeOL2vvPLiHVK6WRHI5G9F9+ICA48QPu7w8JsgsbhycHiOoxnHVcSpOL/7ePEojJc5ooq4AhXdgTr92Q4uADxxkFFWmw=="}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:21.839545 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-89238026-de30-48a1-9a8e-f5aa09679e81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Getting quotas for project 71588f8a5fc34919a77f28b6a8c8db0e. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:19:21.843502 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-89238026-de30-48a1-9a8e-f5aa09679e81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Getting quotas for user 8e3bc7e015f5419aa956568707764f67 and project 71588f8a5fc34919a77f28b6a8c8db0e. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:19:21.866100 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-89238026-de30-48a1-9a8e-f5aa09679e81 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045358 Jun 30 04:19:21.872279 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 285/553] 10.222.0.13 () {62 vars in 1199 bytes} [Thu Jun 30 04:19:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 04:19:21.956410 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ff5bea9a-1863-45ba-878d-edde0397137b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa3299ad-db0c-48d3-baff-6cd0e5d0c95c"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:21.957857 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ff5bea9a-1863-45ba-878d-edde0397137b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:21.965584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ff5bea9a-1863-45ba-878d-edde0397137b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:21.966421 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ff5bea9a-1863-45ba-878d-edde0397137b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:21.967390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ff5bea9a-1863-45ba-878d-edde0397137b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:21.968128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ff5bea9a-1863-45ba-878d-edde0397137b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:22.225009 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ff5bea9a-1863-45ba-878d-edde0397137b tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "POST /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272371 Jun 30 04:19:22.225631 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 269/554] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:19:21 2022] POST /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:19:22.549703 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-e9b23af3-65b2-4212-9c85-0712f7b93074 req-abe99eb1-aa30-49ad-98ae-f76c352846e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef409b2-233a-4846-8e69-31ba8d23f79a", "name": "network-vif-deleted", "tag": "af8ece6c-4794-4310-bde8-88faa37110ff"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:22.559512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-e9b23af3-65b2-4212-9c85-0712f7b93074 req-abe99eb1-aa30-49ad-98ae-f76c352846e3 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:22.559958 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-e9b23af3-65b2-4212-9c85-0712f7b93074 req-abe99eb1-aa30-49ad-98ae-f76c352846e3 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:22.571929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-e9b23af3-65b2-4212-9c85-0712f7b93074 req-abe99eb1-aa30-49ad-98ae-f76c352846e3 service nova] Creating event network-vif-deleted:af8ece6c-4794-4310-bde8-88faa37110ff for instance eef409b2-233a-4846-8e69-31ba8d23f79a on hv-cinder-84684 Jun 30 04:19:22.577723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-e9b23af3-65b2-4212-9c85-0712f7b93074 req-abe99eb1-aa30-49ad-98ae-f76c352846e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033397 Jun 30 04:19:22.578347 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 286/555] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:22.642522 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a1316c95-1fda-4e4e-9cd3-1201426a9351 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:22.643370 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a1316c95-1fda-4e4e-9cd3-1201426a9351 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] [instance: eef409b2-233a-4846-8e69-31ba8d23f79a] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:22.650051 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1316c95-1fda-4e4e-9cd3-1201426a9351 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:22.650491 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1316c95-1fda-4e4e-9cd3-1201426a9351 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:22.651281 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1316c95-1fda-4e4e-9cd3-1201426a9351 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:22.651738 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1316c95-1fda-4e4e-9cd3-1201426a9351 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:22.665735 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-a1316c95-1fda-4e4e-9cd3-1201426a9351 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] HTTP exception thrown: Instance eef409b2-233a-4846-8e69-31ba8d23f79a could not be found. Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a1316c95-1fda-4e4e-9cd3-1201426a9351 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Request method failure captured: Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a HTTP/1.1 Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSObS32u-q54Fms-kyR22_q7uJ0KG8ww8k9WtcK9OWbqkyrYeevH7E6UqQiZNforUpZeOVeS9tGzU_go2KHHmDp0n903YmzLACdqclxxza-ZospPovUPL-2KXNqb0-f8wWwiZe-omIU3znvD5614uhi8wpAESdh5rXl50JdirqiiEI4 Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 4a5e183a36084c9fb82f3a3f7d24402a Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesSnapshotTestJSON-599944138 Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:19:22.667430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a5e183a36084c9fb82f3a3f7d24402a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a5e183a36084c9fb82f3a3f7d24402a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a5e183a36084c9fb82f3a3f7d24402a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a5e183a36084c9fb82f3a3f7d24402a"}]}] Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesSnapshotTestJSON-599944138 Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 4a5e183a36084c9fb82f3a3f7d24402a Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-599944138 Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesSnapshotTestJSON-599944138-project Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: abfd09ef27184291a36b43b6664740c5 Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesSnapshotTestJSON-599944138-project Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance eef409b2-233a-4846-8e69-31ba8d23f79a could not be found. Jun 30 04:19:22.669030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': 'eef409b2-233a-4846-8e69-31ba8d23f79a'} Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eef409b2-233a-4846-8e69-31ba8d23f79a could not be found. Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:19:22.673694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eef409b2-233a-4846-8e69-31ba8d23f79a could not be found. Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eef409b2-233a-4846-8e69-31ba8d23f79a could not be found. Jun 30 04:19:22.675823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:19:22.677151 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a1316c95-1fda-4e4e-9cd3-1201426a9351 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] Returning 404 to user: Instance eef409b2-233a-4846-8e69-31ba8d23f79a could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:19:22.677151 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a1316c95-1fda-4e4e-9cd3-1201426a9351 tempest-VolumesSnapshotTestJSON-599944138 tempest-VolumesSnapshotTestJSON-599944138-project] 10.222.0.13 "GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a" status: 404 len: 111 microversion: 2.1 time: 0.031265 Jun 30 04:19:22.677151 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 270/556] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:22 2022] GET /compute/v2.1/servers/eef409b2-233a-4846-8e69-31ba8d23f79a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:19:23.243295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-422375335", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17fe777c-5046-426d-94b6-3483df1f9f21"}], "security_groups": [{"name": "tempest-securitygroup--1101136696"}], "key_name": "tempest-keypair-1988349919", "user_data": "}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:23.355898 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] validate_networks() for [('17fe777c-5046-426d-94b6-3483df1f9f21', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:19:23.757950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:19:23.758541 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:19:23.758817 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:19:23.759253 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:19:23.759653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:19:23.773830 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:23.774431 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:23.775822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:23.776499 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:23.788635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:23.798257 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Getting quotas for project 71588f8a5fc34919a77f28b6a8c8db0e. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:19:23.803163 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Getting quotas for user 8e3bc7e015f5419aa956568707764f67 and project 71588f8a5fc34919a77f28b6a8c8db0e. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:19:23.815559 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:19:23.817986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:19:23.869375 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-480e296d-5e24-4bfc-91be-d618c4537957 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.631348 Jun 30 04:19:23.870036 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 287/557] 10.222.0.13 () {62 vars in 1187 bytes} [Thu Jun 30 04:19:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 04:19:23.880622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e6892467-7e1c-4295-8c37-79cc278e3781 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:23.881227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e6892467-7e1c-4295-8c37-79cc278e3781 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:23.937736 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e6892467-7e1c-4295-8c37-79cc278e3781 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:23.945056 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e6892467-7e1c-4295-8c37-79cc278e3781 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:23.946580 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e6892467-7e1c-4295-8c37-79cc278e3781 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:23.947761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e6892467-7e1c-4295-8c37-79cc278e3781 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1281 microversion: 2.20 time: 0.071105 Jun 30 04:19:23.949029 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 271/558] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:23 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:24.970562 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-251976b3-d36a-41b0-8615-651841e3b02a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:24.971192 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-251976b3-d36a-41b0-8615-651841e3b02a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:24.978852 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-251976b3-d36a-41b0-8615-651841e3b02a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:24.979360 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-251976b3-d36a-41b0-8615-651841e3b02a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:24.980154 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-251976b3-d36a-41b0-8615-651841e3b02a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:24.980611 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-251976b3-d36a-41b0-8615-651841e3b02a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:25.043503 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-251976b3-d36a-41b0-8615-651841e3b02a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:25.051783 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-251976b3-d36a-41b0-8615-651841e3b02a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:25.053295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-251976b3-d36a-41b0-8615-651841e3b02a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:25.054385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-251976b3-d36a-41b0-8615-651841e3b02a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1333 microversion: 2.20 time: 0.089994 Jun 30 04:19:25.054943 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 288/559] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:24 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:26.074152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-14c45bf9-1a87-44eb-a4dc-e02a83fc37cc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:26.074813 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-14c45bf9-1a87-44eb-a4dc-e02a83fc37cc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:26.083109 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14c45bf9-1a87-44eb-a4dc-e02a83fc37cc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:26.083558 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14c45bf9-1a87-44eb-a4dc-e02a83fc37cc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:26.084309 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14c45bf9-1a87-44eb-a4dc-e02a83fc37cc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:26.084738 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14c45bf9-1a87-44eb-a4dc-e02a83fc37cc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:26.150603 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-14c45bf9-1a87-44eb-a4dc-e02a83fc37cc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:26.159745 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-14c45bf9-1a87-44eb-a4dc-e02a83fc37cc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:26.161259 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-14c45bf9-1a87-44eb-a4dc-e02a83fc37cc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:26.162369 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-14c45bf9-1a87-44eb-a4dc-e02a83fc37cc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1333 microversion: 2.20 time: 0.092676 Jun 30 04:19:26.162962 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 272/560] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:26 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:27.184766 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-90119ab2-deae-411b-82fd-58f0f03cdf50 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:27.185785 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-90119ab2-deae-411b-82fd-58f0f03cdf50 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:27.193346 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-90119ab2-deae-411b-82fd-58f0f03cdf50 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:27.193875 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-90119ab2-deae-411b-82fd-58f0f03cdf50 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:27.194636 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-90119ab2-deae-411b-82fd-58f0f03cdf50 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:27.195068 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-90119ab2-deae-411b-82fd-58f0f03cdf50 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:27.262762 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-90119ab2-deae-411b-82fd-58f0f03cdf50 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:27.271782 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-90119ab2-deae-411b-82fd-58f0f03cdf50 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:27.273165 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-90119ab2-deae-411b-82fd-58f0f03cdf50 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:27.274266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-90119ab2-deae-411b-82fd-58f0f03cdf50 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1333 microversion: 2.20 time: 0.096210 Jun 30 04:19:27.274826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 289/561] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:27 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:28.293132 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e0da702c-a0b0-4fdc-abed-97b99968b9b7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:28.293766 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e0da702c-a0b0-4fdc-abed-97b99968b9b7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:28.301287 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e0da702c-a0b0-4fdc-abed-97b99968b9b7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:28.301906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e0da702c-a0b0-4fdc-abed-97b99968b9b7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:28.302697 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e0da702c-a0b0-4fdc-abed-97b99968b9b7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:28.303126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e0da702c-a0b0-4fdc-abed-97b99968b9b7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:28.386838 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e0da702c-a0b0-4fdc-abed-97b99968b9b7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:28.396043 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e0da702c-a0b0-4fdc-abed-97b99968b9b7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:28.397984 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e0da702c-a0b0-4fdc-abed-97b99968b9b7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:28.399150 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e0da702c-a0b0-4fdc-abed-97b99968b9b7 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1339 microversion: 2.20 time: 0.110015 Jun 30 04:19:28.399730 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 273/562] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:28 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:29.418050 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-abd8d1a4-2d98-4ee7-bd01-57844f689233 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:29.418767 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-abd8d1a4-2d98-4ee7-bd01-57844f689233 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:29.427474 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-abd8d1a4-2d98-4ee7-bd01-57844f689233 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:29.428105 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-abd8d1a4-2d98-4ee7-bd01-57844f689233 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:29.429267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-abd8d1a4-2d98-4ee7-bd01-57844f689233 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:29.429982 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-abd8d1a4-2d98-4ee7-bd01-57844f689233 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:29.446358 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-f1157822-03b2-486d-86eb-8321560ebb25 req-ca2b28f6-9ca2-4fab-94ec-e34f2440a480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a344d61b-2dbc-49a8-b5c1-4d5619af3e77", "tag": "14e3c353-ee55-4eee-8bdc-9d20ccd23a9e"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:29.470567 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-f1157822-03b2-486d-86eb-8321560ebb25 req-ca2b28f6-9ca2-4fab-94ec-e34f2440a480 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:29.473954 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-f1157822-03b2-486d-86eb-8321560ebb25 req-ca2b28f6-9ca2-4fab-94ec-e34f2440a480 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:29.492878 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:29.495423 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-f1157822-03b2-486d-86eb-8321560ebb25 req-ca2b28f6-9ca2-4fab-94ec-e34f2440a480 service nova] Creating event network-changed:14e3c353-ee55-4eee-8bdc-9d20ccd23a9e for instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 on hv-cinder-84684 Jun 30 04:19:29.504019 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-f1157822-03b2-486d-86eb-8321560ebb25 req-ca2b28f6-9ca2-4fab-94ec-e34f2440a480 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062467 Jun 30 04:19:29.504731 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 274/563] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:29.691170 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-abd8d1a4-2d98-4ee7-bd01-57844f689233 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:29.703156 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-abd8d1a4-2d98-4ee7-bd01-57844f689233 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:29.705284 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-abd8d1a4-2d98-4ee7-bd01-57844f689233 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:29.706428 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-abd8d1a4-2d98-4ee7-bd01-57844f689233 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1407 microversion: 2.20 time: 0.292346 Jun 30 04:19:29.716826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 290/564] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:29 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:29.863803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:29.868491 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ca966b37-4bcd-4791-9a14-95195b5cf48e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:29.869176 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ca966b37-4bcd-4791-9a14-95195b5cf48e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:29.877229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca966b37-4bcd-4791-9a14-95195b5cf48e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:29.877666 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca966b37-4bcd-4791-9a14-95195b5cf48e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:29.878419 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca966b37-4bcd-4791-9a14-95195b5cf48e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:29.878843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca966b37-4bcd-4791-9a14-95195b5cf48e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:30.053538 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ca966b37-4bcd-4791-9a14-95195b5cf48e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:30.061729 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ca966b37-4bcd-4791-9a14-95195b5cf48e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1594 microversion: 2.1 time: 0.198818 Jun 30 04:19:30.062493 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 275/565] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:29 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1594 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:30.724753 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-28acecde-b8f2-4271-a126-e75e24fe93e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:30.725347 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-28acecde-b8f2-4271-a126-e75e24fe93e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:30.732175 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-28acecde-b8f2-4271-a126-e75e24fe93e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:30.732621 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-28acecde-b8f2-4271-a126-e75e24fe93e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:30.733370 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-28acecde-b8f2-4271-a126-e75e24fe93e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:30.733873 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-28acecde-b8f2-4271-a126-e75e24fe93e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:30.938536 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-28acecde-b8f2-4271-a126-e75e24fe93e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:30.947115 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-28acecde-b8f2-4271-a126-e75e24fe93e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:30.948657 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-28acecde-b8f2-4271-a126-e75e24fe93e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:30.949769 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-28acecde-b8f2-4271-a126-e75e24fe93e4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1407 microversion: 2.20 time: 0.229016 Jun 30 04:19:30.950340 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 291/566] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:30 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:31.969015 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e28c3312-bfe1-43bc-8e9a-c926ca829203 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:31.969521 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e28c3312-bfe1-43bc-8e9a-c926ca829203 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:31.977531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e28c3312-bfe1-43bc-8e9a-c926ca829203 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:31.978234 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e28c3312-bfe1-43bc-8e9a-c926ca829203 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:31.979268 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e28c3312-bfe1-43bc-8e9a-c926ca829203 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:31.979737 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e28c3312-bfe1-43bc-8e9a-c926ca829203 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:32.053516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-8095c1f4-f554-4323-8ed1-16d2f2a6ad9c req-4dec9a37-90a3-4820-b774-e21fcf14f826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51520645-cd99-466c-83b2-8f735e7d04cf", "tag": "9bba023e-b365-43ab-a64b-b1010d222f8a"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:32.067803 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-8095c1f4-f554-4323-8ed1-16d2f2a6ad9c req-4dec9a37-90a3-4820-b774-e21fcf14f826 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:32.069960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-8095c1f4-f554-4323-8ed1-16d2f2a6ad9c req-4dec9a37-90a3-4820-b774-e21fcf14f826 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:32.079291 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:32.097062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-8095c1f4-f554-4323-8ed1-16d2f2a6ad9c req-4dec9a37-90a3-4820-b774-e21fcf14f826 service nova] Creating event network-changed:9bba023e-b365-43ab-a64b-b1010d222f8a for instance 51520645-cd99-466c-83b2-8f735e7d04cf on hv-cinder-84684 Jun 30 04:19:32.107614 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-8095c1f4-f554-4323-8ed1-16d2f2a6ad9c req-4dec9a37-90a3-4820-b774-e21fcf14f826 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057889 Jun 30 04:19:32.108217 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 292/567] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:19:32.134190 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e28c3312-bfe1-43bc-8e9a-c926ca829203 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:32.145475 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e28c3312-bfe1-43bc-8e9a-c926ca829203 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:32.147349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e28c3312-bfe1-43bc-8e9a-c926ca829203 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:32.148584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e28c3312-bfe1-43bc-8e9a-c926ca829203 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1407 microversion: 2.20 time: 0.183788 Jun 30 04:19:32.149242 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 276/568] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:31 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:33.068918 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-40a67697-7240-4380-a6f6-452a7711bee6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1358399468"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:33.069537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-40a67697-7240-4380-a6f6-452a7711bee6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:33.076969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-40a67697-7240-4380-a6f6-452a7711bee6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:33.077721 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-40a67697-7240-4380-a6f6-452a7711bee6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:33.079084 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-40a67697-7240-4380-a6f6-452a7711bee6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:33.079536 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-40a67697-7240-4380-a6f6-452a7711bee6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:33.167228 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-56b94755-28eb-4c03-a3a5-4f364beb07d5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:33.167838 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-56b94755-28eb-4c03-a3a5-4f364beb07d5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:33.174691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56b94755-28eb-4c03-a3a5-4f364beb07d5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:33.174818 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56b94755-28eb-4c03-a3a5-4f364beb07d5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:33.175550 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56b94755-28eb-4c03-a3a5-4f364beb07d5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:33.175976 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56b94755-28eb-4c03-a3a5-4f364beb07d5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:33.255595 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.network.security_group_api [None req-40a67697-7240-4380-a6f6-452a7711bee6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Adding security group 9d0d7e41-0de4-435b-8be5-77663521a9cc to port 9bba023e-b365-43ab-a64b-b1010d222f8a Jun 30 04:19:33.391198 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-56b94755-28eb-4c03-a3a5-4f364beb07d5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:33.402491 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-56b94755-28eb-4c03-a3a5-4f364beb07d5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:33.406649 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-56b94755-28eb-4c03-a3a5-4f364beb07d5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:33.408526 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-56b94755-28eb-4c03-a3a5-4f364beb07d5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1407 microversion: 2.20 time: 0.244973 Jun 30 04:19:33.411275 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 277/569] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:33 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:19:33.664357 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-40a67697-7240-4380-a6f6-452a7711bee6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "POST /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/action" status: 202 len: 0 microversion: 2.1 time: 0.604683 Jun 30 04:19:33.664967 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 293/570] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:19:33 2022] POST /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:19:33.673693 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7a9ba753-fb01-4ebe-8055-e939c564d6e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:33.674304 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7a9ba753-fb01-4ebe-8055-e939c564d6e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:33.681094 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a9ba753-fb01-4ebe-8055-e939c564d6e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:33.681537 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a9ba753-fb01-4ebe-8055-e939c564d6e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:33.682626 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a9ba753-fb01-4ebe-8055-e939c564d6e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:33.682978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a9ba753-fb01-4ebe-8055-e939c564d6e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:33.838603 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7a9ba753-fb01-4ebe-8055-e939c564d6e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:33.846670 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7a9ba753-fb01-4ebe-8055-e939c564d6e2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1641 microversion: 2.1 time: 0.177180 Jun 30 04:19:33.847264 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 278/571] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:19:33 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1641 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:19:34.124999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:34.125775 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=10 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:34.130535 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-9ba5b182-d2d6-4953-b3cd-8924cc730de7 req-2899fb26-aa4c-49fb-937d-ea860dd3ec10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51520645-cd99-466c-83b2-8f735e7d04cf", "tag": "9bba023e-b365-43ab-a64b-b1010d222f8a"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:34.139486 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-9ba5b182-d2d6-4953-b3cd-8924cc730de7 req-2899fb26-aa4c-49fb-937d-ea860dd3ec10 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:34.139921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-9ba5b182-d2d6-4953-b3cd-8924cc730de7 req-2899fb26-aa4c-49fb-937d-ea860dd3ec10 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:34.150929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-9ba5b182-d2d6-4953-b3cd-8924cc730de7 req-2899fb26-aa4c-49fb-937d-ea860dd3ec10 service nova] Creating event network-changed:9bba023e-b365-43ab-a64b-b1010d222f8a for instance 51520645-cd99-466c-83b2-8f735e7d04cf on hv-cinder-84684 Jun 30 04:19:34.156585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-9ba5b182-d2d6-4953-b3cd-8924cc730de7 req-2899fb26-aa4c-49fb-937d-ea860dd3ec10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032788 Jun 30 04:19:34.157179 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 294/572] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:34.429635 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7c7414ee-fbc1-4d9f-9376-05b0c66fc6e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:34.430391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7c7414ee-fbc1-4d9f-9376-05b0c66fc6e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:34.433121 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:19:34.442461 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c7414ee-fbc1-4d9f-9376-05b0c66fc6e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:34.443171 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c7414ee-fbc1-4d9f-9376-05b0c66fc6e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:34.444313 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c7414ee-fbc1-4d9f-9376-05b0c66fc6e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:34.444972 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c7414ee-fbc1-4d9f-9376-05b0c66fc6e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:35.026659 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7c7414ee-fbc1-4d9f-9376-05b0c66fc6e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:35.036429 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7c7414ee-fbc1-4d9f-9376-05b0c66fc6e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:35.038423 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7c7414ee-fbc1-4d9f-9376-05b0c66fc6e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:35.040378 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7c7414ee-fbc1-4d9f-9376-05b0c66fc6e8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1407 microversion: 2.20 time: 0.616775 Jun 30 04:19:35.051372 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 279/573] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:34 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1407 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:36.059495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-23181837-21b1-4227-89f3-8b9c977b7b13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:36.060105 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-23181837-21b1-4227-89f3-8b9c977b7b13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:36.066642 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-23181837-21b1-4227-89f3-8b9c977b7b13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:36.067089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-23181837-21b1-4227-89f3-8b9c977b7b13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:36.067872 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-23181837-21b1-4227-89f3-8b9c977b7b13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:36.068301 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-23181837-21b1-4227-89f3-8b9c977b7b13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:36.217075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-23181837-21b1-4227-89f3-8b9c977b7b13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:36.226931 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-23181837-21b1-4227-89f3-8b9c977b7b13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:36.228470 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-23181837-21b1-4227-89f3-8b9c977b7b13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:36.229579 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-23181837-21b1-4227-89f3-8b9c977b7b13 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1407 microversion: 2.20 time: 0.175125 Jun 30 04:19:36.230149 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 295/574] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:36 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:36.734657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-706dbd51-aba7-4cb5-a1c8-3ff7d6bf2421 req-6de04e1b-3925-4bf1-9f01-a4759352e5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a344d61b-2dbc-49a8-b5c1-4d5619af3e77", "name": "network-vif-plugged", "status": "completed", "tag": "14e3c353-ee55-4eee-8bdc-9d20ccd23a9e"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:36.743447 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-706dbd51-aba7-4cb5-a1c8-3ff7d6bf2421 req-6de04e1b-3925-4bf1-9f01-a4759352e5a7 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:36.743891 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-706dbd51-aba7-4cb5-a1c8-3ff7d6bf2421 req-6de04e1b-3925-4bf1-9f01-a4759352e5a7 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:36.755893 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-706dbd51-aba7-4cb5-a1c8-3ff7d6bf2421 req-6de04e1b-3925-4bf1-9f01-a4759352e5a7 service nova] Creating event network-vif-plugged:14e3c353-ee55-4eee-8bdc-9d20ccd23a9e for instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 on hv-cinder-84684 Jun 30 04:19:36.761220 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-706dbd51-aba7-4cb5-a1c8-3ff7d6bf2421 req-6de04e1b-3925-4bf1-9f01-a4759352e5a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030689 Jun 30 04:19:36.761818 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 280/575] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:19:37.250937 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e2ffd281-55d1-4038-997b-7eb89b8a8732 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:37.251550 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e2ffd281-55d1-4038-997b-7eb89b8a8732 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:37.259123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e2ffd281-55d1-4038-997b-7eb89b8a8732 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:37.259735 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e2ffd281-55d1-4038-997b-7eb89b8a8732 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:37.260600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e2ffd281-55d1-4038-997b-7eb89b8a8732 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:37.261146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e2ffd281-55d1-4038-997b-7eb89b8a8732 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:37.402246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e2ffd281-55d1-4038-997b-7eb89b8a8732 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:37.410997 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e2ffd281-55d1-4038-997b-7eb89b8a8732 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:37.412544 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e2ffd281-55d1-4038-997b-7eb89b8a8732 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:37.413697 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e2ffd281-55d1-4038-997b-7eb89b8a8732 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1407 microversion: 2.20 time: 0.168794 Jun 30 04:19:37.414230 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 296/576] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:37 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:38.436049 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1ae11492-078d-40ff-8e9d-166fd42d9a82 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:38.437053 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1ae11492-078d-40ff-8e9d-166fd42d9a82 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:38.446049 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ae11492-078d-40ff-8e9d-166fd42d9a82 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:38.446693 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ae11492-078d-40ff-8e9d-166fd42d9a82 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:38.447850 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ae11492-078d-40ff-8e9d-166fd42d9a82 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:38.448482 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ae11492-078d-40ff-8e9d-166fd42d9a82 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:38.593358 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1ae11492-078d-40ff-8e9d-166fd42d9a82 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:38.602045 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1ae11492-078d-40ff-8e9d-166fd42d9a82 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:38.603613 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1ae11492-078d-40ff-8e9d-166fd42d9a82 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:38.604764 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1ae11492-078d-40ff-8e9d-166fd42d9a82 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1407 microversion: 2.20 time: 0.176271 Jun 30 04:19:38.605327 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 281/577] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:38 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:39.624801 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6aa156e4-86e8-4932-ad34-7c7eec7ae6fc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:39.626191 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6aa156e4-86e8-4932-ad34-7c7eec7ae6fc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:39.636204 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6aa156e4-86e8-4932-ad34-7c7eec7ae6fc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:39.636650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6aa156e4-86e8-4932-ad34-7c7eec7ae6fc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:39.637799 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6aa156e4-86e8-4932-ad34-7c7eec7ae6fc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:39.638267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6aa156e4-86e8-4932-ad34-7c7eec7ae6fc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:39.773508 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6aa156e4-86e8-4932-ad34-7c7eec7ae6fc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:39.782197 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6aa156e4-86e8-4932-ad34-7c7eec7ae6fc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:39.783729 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6aa156e4-86e8-4932-ad34-7c7eec7ae6fc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:19:39.784881 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6aa156e4-86e8-4932-ad34-7c7eec7ae6fc tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1599 microversion: 2.20 time: 0.165724 Jun 30 04:19:39.785425 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 297/578] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:19:39 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:19:39.802763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b5531a15-2f24-4141-bc9a-82f84d883322 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:19:39.803406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b5531a15-2f24-4141-bc9a-82f84d883322 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:19:39.810740 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5531a15-2f24-4141-bc9a-82f84d883322 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:39.811231 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5531a15-2f24-4141-bc9a-82f84d883322 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:39.812381 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5531a15-2f24-4141-bc9a-82f84d883322 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:39.813038 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5531a15-2f24-4141-bc9a-82f84d883322 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:39.900859 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b5531a15-2f24-4141-bc9a-82f84d883322 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101849 Jun 30 04:19:39.901663 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 282/579] 10.222.0.13 () {60 vars in 1315 bytes} [Thu Jun 30 04:19:39 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:19:41.065813 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-bb8402c1-f6e5-4b33-a134-1f1392bffbcb req-9e78b937-4cae-486f-8768-f3f7cd66207b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a344d61b-2dbc-49a8-b5c1-4d5619af3e77", "tag": "14e3c353-ee55-4eee-8bdc-9d20ccd23a9e"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:19:41.074694 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-bb8402c1-f6e5-4b33-a134-1f1392bffbcb req-9e78b937-4cae-486f-8768-f3f7cd66207b service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:19:41.075125 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-bb8402c1-f6e5-4b33-a134-1f1392bffbcb req-9e78b937-4cae-486f-8768-f3f7cd66207b service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:19:41.087375 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-bb8402c1-f6e5-4b33-a134-1f1392bffbcb req-9e78b937-4cae-486f-8768-f3f7cd66207b service nova] Creating event network-changed:14e3c353-ee55-4eee-8bdc-9d20ccd23a9e for instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 on hv-cinder-84684 Jun 30 04:19:41.092469 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-bb8402c1-f6e5-4b33-a134-1f1392bffbcb req-9e78b937-4cae-486f-8768-f3f7cd66207b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030623 Jun 30 04:19:41.093303 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 298/580] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:20:13.409848 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=43 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:20:13.410636 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=42 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:20:13.414895 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c1cb7bf0-f4e6-4fc6-9f20-e2854039be28 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41fca21a-168a-48a8-89de-222250bd56c2"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:20:13.416020 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c1cb7bf0-f4e6-4fc6-9f20-e2854039be28 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:13.423176 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1cb7bf0-f4e6-4fc6-9f20-e2854039be28 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:13.423626 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1cb7bf0-f4e6-4fc6-9f20-e2854039be28 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:13.424388 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1cb7bf0-f4e6-4fc6-9f20-e2854039be28 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:13.424815 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1cb7bf0-f4e6-4fc6-9f20-e2854039be28 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:13.924449 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c1cb7bf0-f4e6-4fc6-9f20-e2854039be28 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515859 Jun 30 04:20:13.925235 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 283/581] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:20:13 2022] POST /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:20:16.719636 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f4ac450e-891a-413f-8215-f4753b0aba69 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:20:16.720963 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f4ac450e-891a-413f-8215-f4753b0aba69 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:16.723124 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:20:16.723807 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=26 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:20:16.730183 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f4ac450e-891a-413f-8215-f4753b0aba69 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:16.730623 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f4ac450e-891a-413f-8215-f4753b0aba69 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:16.731403 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f4ac450e-891a-413f-8215-f4753b0aba69 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:16.731830 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f4ac450e-891a-413f-8215-f4753b0aba69 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:16.815123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f4ac450e-891a-413f-8215-f4753b0aba69 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "POST /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/action" status: 202 len: 0 microversion: 2.1 time: 0.100720 Jun 30 04:20:16.815790 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 299/582] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:20:16 2022] POST /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:20:16.824428 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9884cea3-74ef-474a-8610-4f95c047cdb4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:16.825289 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9884cea3-74ef-474a-8610-4f95c047cdb4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:16.832910 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9884cea3-74ef-474a-8610-4f95c047cdb4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:16.833329 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9884cea3-74ef-474a-8610-4f95c047cdb4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:16.834197 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9884cea3-74ef-474a-8610-4f95c047cdb4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:16.834792 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9884cea3-74ef-474a-8610-4f95c047cdb4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:17.068507 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9884cea3-74ef-474a-8610-4f95c047cdb4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:17.077573 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9884cea3-74ef-474a-8610-4f95c047cdb4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1751 microversion: 2.1 time: 0.257029 Jun 30 04:20:17.078077 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 284/583] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:16 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:18.101403 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-98104f93-20f4-4ba3-808c-795084779d07 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:18.102561 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-98104f93-20f4-4ba3-808c-795084779d07 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:18.112169 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98104f93-20f4-4ba3-808c-795084779d07 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:18.112611 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98104f93-20f4-4ba3-808c-795084779d07 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:18.113372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98104f93-20f4-4ba3-808c-795084779d07 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:18.113803 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-98104f93-20f4-4ba3-808c-795084779d07 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:18.370399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-98104f93-20f4-4ba3-808c-795084779d07 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:18.379244 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-98104f93-20f4-4ba3-808c-795084779d07 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.285831 Jun 30 04:20:18.379794 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 300/584] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:18 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:19.399337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4a120dec-bfb6-444d-8876-5c53c020dad9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:19.399872 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4a120dec-bfb6-444d-8876-5c53c020dad9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:19.408845 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a120dec-bfb6-444d-8876-5c53c020dad9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:19.409288 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a120dec-bfb6-444d-8876-5c53c020dad9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:19.410042 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a120dec-bfb6-444d-8876-5c53c020dad9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:19.410466 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a120dec-bfb6-444d-8876-5c53c020dad9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:19.555889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4a120dec-bfb6-444d-8876-5c53c020dad9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:19.565005 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4a120dec-bfb6-444d-8876-5c53c020dad9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.169683 Jun 30 04:20:19.565541 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 285/585] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:19 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:20.582215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b808617e-7e7b-44d6-bf83-49359e45ecff tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:20.582830 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b808617e-7e7b-44d6-bf83-49359e45ecff tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:20.589793 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b808617e-7e7b-44d6-bf83-49359e45ecff tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:20.590236 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b808617e-7e7b-44d6-bf83-49359e45ecff tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:20.591020 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b808617e-7e7b-44d6-bf83-49359e45ecff tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:20.591481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b808617e-7e7b-44d6-bf83-49359e45ecff tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:20.737978 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b808617e-7e7b-44d6-bf83-49359e45ecff tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:20.750277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b808617e-7e7b-44d6-bf83-49359e45ecff tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.171834 Jun 30 04:20:20.750952 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 301/586] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:20 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:21.484788 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-73e167fa-79d4-43a9-a1fc-0d94a9cb99eb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:20:21.485787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-73e167fa-79d4-43a9-a1fc-0d94a9cb99eb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:21.492436 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73e167fa-79d4-43a9-a1fc-0d94a9cb99eb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:21.492883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73e167fa-79d4-43a9-a1fc-0d94a9cb99eb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:21.493634 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73e167fa-79d4-43a9-a1fc-0d94a9cb99eb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:21.494065 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73e167fa-79d4-43a9-a1fc-0d94a9cb99eb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:21.518171 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-73e167fa-79d4-43a9-a1fc-0d94a9cb99eb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lazy-loading 'flavor' on Instance uuid 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:20:21.650608 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-73e167fa-79d4-43a9-a1fc-0d94a9cb99eb tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/action" status: 200 len: 32 microversion: 2.1 time: 0.169851 Jun 30 04:20:21.659283 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 286/587] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:20:21 2022] POST /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 04:20:21.665487 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d1d85886-4012-4aea-9c0d-aaf9247e6670 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:21.666200 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d1d85886-4012-4aea-9c0d-aaf9247e6670 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:21.673982 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d1d85886-4012-4aea-9c0d-aaf9247e6670 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:21.674523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d1d85886-4012-4aea-9c0d-aaf9247e6670 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:21.675352 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d1d85886-4012-4aea-9c0d-aaf9247e6670 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:21.675779 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d1d85886-4012-4aea-9c0d-aaf9247e6670 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:21.768761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b5294ee2-b2d1-450e-bc7a-fe7fa4526166 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:21.769930 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b5294ee2-b2d1-450e-bc7a-fe7fa4526166 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:21.776542 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5294ee2-b2d1-450e-bc7a-fe7fa4526166 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:21.776986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5294ee2-b2d1-450e-bc7a-fe7fa4526166 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:21.777756 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5294ee2-b2d1-450e-bc7a-fe7fa4526166 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:21.778536 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5294ee2-b2d1-450e-bc7a-fe7fa4526166 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:21.965234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d1d85886-4012-4aea-9c0d-aaf9247e6670 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:21.974397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d1d85886-4012-4aea-9c0d-aaf9247e6670 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.312836 Jun 30 04:20:21.974944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 302/588] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:21 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:20:22.060539 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b5294ee2-b2d1-450e-bc7a-fe7fa4526166 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:22.069297 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b5294ee2-b2d1-450e-bc7a-fe7fa4526166 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.304900 Jun 30 04:20:22.079742 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 287/589] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:21 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:22.089430 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-65c44387-05e6-4cdd-9f65-a9790872d29b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:22.090004 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-65c44387-05e6-4cdd-9f65-a9790872d29b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:22.096496 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-65c44387-05e6-4cdd-9f65-a9790872d29b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:22.097217 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-65c44387-05e6-4cdd-9f65-a9790872d29b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:22.097983 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-65c44387-05e6-4cdd-9f65-a9790872d29b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:22.098436 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-65c44387-05e6-4cdd-9f65-a9790872d29b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:22.120945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-65c44387-05e6-4cdd-9f65-a9790872d29b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/ips" status: 200 len: 152 microversion: 2.20 time: 0.144669 Jun 30 04:20:22.121511 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 303/590] 10.222.0.13 () {60 vars in 1288 bytes} [Thu Jun 30 04:20:21 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/ips => generated 152 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:20:22.992369 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-32985d1d-fe0e-4cef-a272-2244a3ce7f02 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:22.992928 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-32985d1d-fe0e-4cef-a272-2244a3ce7f02 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:22.999941 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-32985d1d-fe0e-4cef-a272-2244a3ce7f02 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:23.000381 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-32985d1d-fe0e-4cef-a272-2244a3ce7f02 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:23.001132 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-32985d1d-fe0e-4cef-a272-2244a3ce7f02 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:23.001643 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-32985d1d-fe0e-4cef-a272-2244a3ce7f02 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:23.086514 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-81dae3f0-90c1-4ea3-819a-a8f4173906d9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:23.087277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-81dae3f0-90c1-4ea3-819a-a8f4173906d9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:23.093977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-81dae3f0-90c1-4ea3-819a-a8f4173906d9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:23.094544 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-81dae3f0-90c1-4ea3-819a-a8f4173906d9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:23.095329 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-81dae3f0-90c1-4ea3-819a-a8f4173906d9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:23.096001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-81dae3f0-90c1-4ea3-819a-a8f4173906d9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:23.175121 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-32985d1d-fe0e-4cef-a272-2244a3ce7f02 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:23.183448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-32985d1d-fe0e-4cef-a272-2244a3ce7f02 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.195101 Jun 30 04:20:23.184074 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 288/591] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:22 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:23.249789 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-81dae3f0-90c1-4ea3-819a-a8f4173906d9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:23.257968 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-81dae3f0-90c1-4ea3-819a-a8f4173906d9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.175376 Jun 30 04:20:23.258914 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 304/592] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:23 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:24.201095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ab25042a-2fd1-4d93-be3a-8fa0b3e0f441 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:24.201717 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ab25042a-2fd1-4d93-be3a-8fa0b3e0f441 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:24.209046 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab25042a-2fd1-4d93-be3a-8fa0b3e0f441 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:24.209493 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab25042a-2fd1-4d93-be3a-8fa0b3e0f441 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:24.210251 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab25042a-2fd1-4d93-be3a-8fa0b3e0f441 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:24.210684 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab25042a-2fd1-4d93-be3a-8fa0b3e0f441 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:24.276257 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a9bb81b9-6f2a-4f0e-a786-ad41e008b907 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:24.276851 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a9bb81b9-6f2a-4f0e-a786-ad41e008b907 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:24.284261 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9bb81b9-6f2a-4f0e-a786-ad41e008b907 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:24.284702 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9bb81b9-6f2a-4f0e-a786-ad41e008b907 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:24.285499 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9bb81b9-6f2a-4f0e-a786-ad41e008b907 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:24.285849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9bb81b9-6f2a-4f0e-a786-ad41e008b907 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:24.392500 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ab25042a-2fd1-4d93-be3a-8fa0b3e0f441 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:24.405517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ab25042a-2fd1-4d93-be3a-8fa0b3e0f441 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.208017 Jun 30 04:20:24.406283 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 289/593] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:24 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:24.457381 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a9bb81b9-6f2a-4f0e-a786-ad41e008b907 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:24.469348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a9bb81b9-6f2a-4f0e-a786-ad41e008b907 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.196831 Jun 30 04:20:24.470111 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 305/594] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:24 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:24.557139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-72f3a71e-b656-4735-baaa-c70bdd57c5c6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:20:24.557677 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-72f3a71e-b656-4735-baaa-c70bdd57c5c6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:24.564830 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72f3a71e-b656-4735-baaa-c70bdd57c5c6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:24.565280 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72f3a71e-b656-4735-baaa-c70bdd57c5c6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:24.566052 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72f3a71e-b656-4735-baaa-c70bdd57c5c6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:24.566483 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72f3a71e-b656-4735-baaa-c70bdd57c5c6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:24.590392 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-72f3a71e-b656-4735-baaa-c70bdd57c5c6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lazy-loading 'flavor' on Instance uuid a344d61b-2dbc-49a8-b5c1-4d5619af3e77 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:20:24.864897 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-72f3a71e-b656-4735-baaa-c70bdd57c5c6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "POST /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/action" status: 202 len: 0 microversion: 2.20 time: 0.311598 Jun 30 04:20:24.865501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 290/595] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 30 04:20:24 2022] POST /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:20:24.874893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-738a6f08-7dbe-4eac-839c-3c8c00fcc859 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:24.875493 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-738a6f08-7dbe-4eac-839c-3c8c00fcc859 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:24.882396 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-738a6f08-7dbe-4eac-839c-3c8c00fcc859 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:24.882892 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-738a6f08-7dbe-4eac-839c-3c8c00fcc859 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:24.883885 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-738a6f08-7dbe-4eac-839c-3c8c00fcc859 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:24.884421 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-738a6f08-7dbe-4eac-839c-3c8c00fcc859 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:25.026159 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-738a6f08-7dbe-4eac-839c-3c8c00fcc859 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:25.035737 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-738a6f08-7dbe-4eac-839c-3c8c00fcc859 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:25.037247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-738a6f08-7dbe-4eac-839c-3c8c00fcc859 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:25.038416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-738a6f08-7dbe-4eac-839c-3c8c00fcc859 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.168281 Jun 30 04:20:25.038982 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 306/596] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:24 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:25.426214 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-45ba9c91-335a-4e21-995d-fc6aac7295d1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:25.426782 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-45ba9c91-335a-4e21-995d-fc6aac7295d1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:25.434259 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-45ba9c91-335a-4e21-995d-fc6aac7295d1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:25.434259 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-45ba9c91-335a-4e21-995d-fc6aac7295d1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:25.434981 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-45ba9c91-335a-4e21-995d-fc6aac7295d1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:25.435454 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-45ba9c91-335a-4e21-995d-fc6aac7295d1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:25.487134 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bc13a31d-917f-4cf0-97ba-5862431920da tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:25.487759 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-bc13a31d-917f-4cf0-97ba-5862431920da tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:25.494733 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bc13a31d-917f-4cf0-97ba-5862431920da tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:25.495186 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bc13a31d-917f-4cf0-97ba-5862431920da tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:25.495976 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bc13a31d-917f-4cf0-97ba-5862431920da tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:25.496407 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bc13a31d-917f-4cf0-97ba-5862431920da tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:25.613573 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-45ba9c91-335a-4e21-995d-fc6aac7295d1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:25.625823 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-45ba9c91-335a-4e21-995d-fc6aac7295d1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.204758 Jun 30 04:20:25.626824 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 291/597] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:25 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:25.676405 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-bc13a31d-917f-4cf0-97ba-5862431920da tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:25.684700 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bc13a31d-917f-4cf0-97ba-5862431920da tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.201670 Jun 30 04:20:25.685278 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 307/598] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:25 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:26.061470 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e929aa62-2b83-47be-86d6-a823e3a1d3e0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:26.062459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e929aa62-2b83-47be-86d6-a823e3a1d3e0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:26.075354 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e929aa62-2b83-47be-86d6-a823e3a1d3e0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:26.076096 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e929aa62-2b83-47be-86d6-a823e3a1d3e0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:26.077331 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e929aa62-2b83-47be-86d6-a823e3a1d3e0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:26.078041 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e929aa62-2b83-47be-86d6-a823e3a1d3e0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:26.236439 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e929aa62-2b83-47be-86d6-a823e3a1d3e0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:26.244979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e929aa62-2b83-47be-86d6-a823e3a1d3e0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:26.246457 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e929aa62-2b83-47be-86d6-a823e3a1d3e0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:26.247664 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e929aa62-2b83-47be-86d6-a823e3a1d3e0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.193111 Jun 30 04:20:26.248230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 292/599] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:26 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:26.649238 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1c8d0c56-1a4d-4be6-a62d-f011cab1c4fe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:26.650205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1c8d0c56-1a4d-4be6-a62d-f011cab1c4fe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:26.660406 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1c8d0c56-1a4d-4be6-a62d-f011cab1c4fe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:26.660858 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1c8d0c56-1a4d-4be6-a62d-f011cab1c4fe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:26.661614 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1c8d0c56-1a4d-4be6-a62d-f011cab1c4fe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:26.662042 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1c8d0c56-1a4d-4be6-a62d-f011cab1c4fe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:26.702069 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7f65ecc6-155b-494c-875f-c3da58c32313 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:26.702652 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7f65ecc6-155b-494c-875f-c3da58c32313 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:26.709880 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f65ecc6-155b-494c-875f-c3da58c32313 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:26.710319 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f65ecc6-155b-494c-875f-c3da58c32313 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:26.711077 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f65ecc6-155b-494c-875f-c3da58c32313 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:26.711536 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f65ecc6-155b-494c-875f-c3da58c32313 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:26.841612 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1c8d0c56-1a4d-4be6-a62d-f011cab1c4fe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:26.850563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1c8d0c56-1a4d-4be6-a62d-f011cab1c4fe tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.208652 Jun 30 04:20:26.851370 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 308/600] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:26 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:26.884832 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7f65ecc6-155b-494c-875f-c3da58c32313 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:26.893660 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7f65ecc6-155b-494c-875f-c3da58c32313 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.195275 Jun 30 04:20:26.894207 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 293/601] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:26 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:20:27.270174 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f75245d4-be13-4d37-9ed2-d272b66220a4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:27.271171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f75245d4-be13-4d37-9ed2-d272b66220a4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:27.281866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f75245d4-be13-4d37-9ed2-d272b66220a4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:27.282618 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f75245d4-be13-4d37-9ed2-d272b66220a4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:27.283583 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f75245d4-be13-4d37-9ed2-d272b66220a4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:27.284012 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f75245d4-be13-4d37-9ed2-d272b66220a4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:27.424935 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f75245d4-be13-4d37-9ed2-d272b66220a4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:27.436609 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f75245d4-be13-4d37-9ed2-d272b66220a4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:27.438886 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f75245d4-be13-4d37-9ed2-d272b66220a4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:27.440282 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f75245d4-be13-4d37-9ed2-d272b66220a4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.176784 Jun 30 04:20:27.440850 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 309/602] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:27 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:27.873025 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-714b9cf7-85b1-405e-a730-509f72e020ae tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:27.873965 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-714b9cf7-85b1-405e-a730-509f72e020ae tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:27.882192 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-714b9cf7-85b1-405e-a730-509f72e020ae tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:27.882644 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-714b9cf7-85b1-405e-a730-509f72e020ae tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:27.883443 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-714b9cf7-85b1-405e-a730-509f72e020ae tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:27.883878 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-714b9cf7-85b1-405e-a730-509f72e020ae tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:27.888040 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:20:27.911766 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-444c73ee-650e-4aba-8a8e-0cc724b86afa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:27.912348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-444c73ee-650e-4aba-8a8e-0cc724b86afa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:27.919537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-444c73ee-650e-4aba-8a8e-0cc724b86afa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:27.919973 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-444c73ee-650e-4aba-8a8e-0cc724b86afa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:27.920736 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-444c73ee-650e-4aba-8a8e-0cc724b86afa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:27.921160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-444c73ee-650e-4aba-8a8e-0cc724b86afa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:28.075870 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-714b9cf7-85b1-405e-a730-509f72e020ae tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:28.084365 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-714b9cf7-85b1-405e-a730-509f72e020ae tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.217902 Jun 30 04:20:28.084949 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 294/603] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:27 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:28.116168 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-444c73ee-650e-4aba-8a8e-0cc724b86afa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:28.128053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-444c73ee-650e-4aba-8a8e-0cc724b86afa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.220693 Jun 30 04:20:28.128596 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 310/604] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:27 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:28.466185 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a738eddf-3a00-4a4c-a73e-dfe4884f05a6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:28.467288 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a738eddf-3a00-4a4c-a73e-dfe4884f05a6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:28.477752 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a738eddf-3a00-4a4c-a73e-dfe4884f05a6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:28.478482 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a738eddf-3a00-4a4c-a73e-dfe4884f05a6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:28.479786 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a738eddf-3a00-4a4c-a73e-dfe4884f05a6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:28.480484 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a738eddf-3a00-4a4c-a73e-dfe4884f05a6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:28.877799 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a738eddf-3a00-4a4c-a73e-dfe4884f05a6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:28.888621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a738eddf-3a00-4a4c-a73e-dfe4884f05a6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:28.890959 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a738eddf-3a00-4a4c-a73e-dfe4884f05a6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:28.892806 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a738eddf-3a00-4a4c-a73e-dfe4884f05a6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.432836 Jun 30 04:20:28.893529 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 295/605] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:28 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:29.105159 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7329065f-a7e3-41e6-928e-588cfbeb4d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:29.106128 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7329065f-a7e3-41e6-928e-588cfbeb4d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:29.114652 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7329065f-a7e3-41e6-928e-588cfbeb4d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:29.115120 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7329065f-a7e3-41e6-928e-588cfbeb4d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:29.115887 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7329065f-a7e3-41e6-928e-588cfbeb4d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:29.116311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7329065f-a7e3-41e6-928e-588cfbeb4d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:29.150046 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8a457c00-592a-4c73-8820-f6742e894e82 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:29.150701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8a457c00-592a-4c73-8820-f6742e894e82 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:29.160238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a457c00-592a-4c73-8820-f6742e894e82 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:29.160967 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a457c00-592a-4c73-8820-f6742e894e82 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:29.162257 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a457c00-592a-4c73-8820-f6742e894e82 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:29.162990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a457c00-592a-4c73-8820-f6742e894e82 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:29.306102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7329065f-a7e3-41e6-928e-588cfbeb4d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:29.315132 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7329065f-a7e3-41e6-928e-588cfbeb4d55 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.216067 Jun 30 04:20:29.315756 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 311/606] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:29 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:29.362856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8a457c00-592a-4c73-8820-f6742e894e82 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:29.372414 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8a457c00-592a-4c73-8820-f6742e894e82 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.226332 Jun 30 04:20:29.373053 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 296/607] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:29 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:29.920966 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-63d202c2-72e7-4348-a555-ae045a1f1b9b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:29.921745 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-63d202c2-72e7-4348-a555-ae045a1f1b9b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:29.929370 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-63d202c2-72e7-4348-a555-ae045a1f1b9b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:29.929815 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-63d202c2-72e7-4348-a555-ae045a1f1b9b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:29.930567 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-63d202c2-72e7-4348-a555-ae045a1f1b9b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:29.930957 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-63d202c2-72e7-4348-a555-ae045a1f1b9b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:30.076304 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-63d202c2-72e7-4348-a555-ae045a1f1b9b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:30.086045 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-63d202c2-72e7-4348-a555-ae045a1f1b9b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:30.087575 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-63d202c2-72e7-4348-a555-ae045a1f1b9b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:30.088736 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-63d202c2-72e7-4348-a555-ae045a1f1b9b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.174617 Jun 30 04:20:30.089296 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 312/608] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:29 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:30.339235 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a3611d6d-766a-452b-8130-9527cdb090e2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:30.339836 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a3611d6d-766a-452b-8130-9527cdb090e2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:30.348039 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a3611d6d-766a-452b-8130-9527cdb090e2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:30.348488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a3611d6d-766a-452b-8130-9527cdb090e2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:30.349254 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a3611d6d-766a-452b-8130-9527cdb090e2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:30.349685 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a3611d6d-766a-452b-8130-9527cdb090e2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:30.390327 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fd926c17-a324-4bbd-bffd-af7c86b8a331 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:30.390904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fd926c17-a324-4bbd-bffd-af7c86b8a331 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:30.397976 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd926c17-a324-4bbd-bffd-af7c86b8a331 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:30.398436 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd926c17-a324-4bbd-bffd-af7c86b8a331 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:30.399217 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd926c17-a324-4bbd-bffd-af7c86b8a331 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:30.399650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd926c17-a324-4bbd-bffd-af7c86b8a331 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:30.536000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a3611d6d-766a-452b-8130-9527cdb090e2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:30.544860 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a3611d6d-766a-452b-8130-9527cdb090e2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.210312 Jun 30 04:20:30.545637 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 297/609] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:30 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:30.576008 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fd926c17-a324-4bbd-bffd-af7c86b8a331 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:30.584684 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fd926c17-a324-4bbd-bffd-af7c86b8a331 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.198272 Jun 30 04:20:30.585267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 313/610] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:30 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:31.108346 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ca722899-6187-4016-856d-f1a86bb9f973 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:31.108947 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ca722899-6187-4016-856d-f1a86bb9f973 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:31.117434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca722899-6187-4016-856d-f1a86bb9f973 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:31.118084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca722899-6187-4016-856d-f1a86bb9f973 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:31.119349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca722899-6187-4016-856d-f1a86bb9f973 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:31.120067 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca722899-6187-4016-856d-f1a86bb9f973 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:31.254568 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ca722899-6187-4016-856d-f1a86bb9f973 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:31.263068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ca722899-6187-4016-856d-f1a86bb9f973 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:31.264709 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ca722899-6187-4016-856d-f1a86bb9f973 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:31.266010 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ca722899-6187-4016-856d-f1a86bb9f973 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.161759 Jun 30 04:20:31.266534 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 298/611] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:31 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:31.566539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-aba967c0-dab9-4292-a8f7-ea5ca311d09b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:31.567575 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-aba967c0-dab9-4292-a8f7-ea5ca311d09b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:31.578782 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aba967c0-dab9-4292-a8f7-ea5ca311d09b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:31.579707 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aba967c0-dab9-4292-a8f7-ea5ca311d09b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:31.580735 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aba967c0-dab9-4292-a8f7-ea5ca311d09b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:31.581160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aba967c0-dab9-4292-a8f7-ea5ca311d09b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:31.602136 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2a163d72-b090-4c70-8725-044b55976c4d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:31.602786 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2a163d72-b090-4c70-8725-044b55976c4d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:31.609791 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a163d72-b090-4c70-8725-044b55976c4d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:31.610239 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a163d72-b090-4c70-8725-044b55976c4d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:31.611002 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a163d72-b090-4c70-8725-044b55976c4d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:31.611950 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a163d72-b090-4c70-8725-044b55976c4d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:31.777326 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-aba967c0-dab9-4292-a8f7-ea5ca311d09b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:31.781506 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:20:31.786790 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-aba967c0-dab9-4292-a8f7-ea5ca311d09b tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.227432 Jun 30 04:20:31.787422 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 314/612] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:31 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:31.804060 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2a163d72-b090-4c70-8725-044b55976c4d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:31.812317 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2a163d72-b090-4c70-8725-044b55976c4d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.214164 Jun 30 04:20:31.812885 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 299/613] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:31 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:32.285947 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a5bb5302-163a-474b-a3cb-a6b99246c564 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:32.286570 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a5bb5302-163a-474b-a3cb-a6b99246c564 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:32.293674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a5bb5302-163a-474b-a3cb-a6b99246c564 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:32.294114 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a5bb5302-163a-474b-a3cb-a6b99246c564 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:32.294865 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a5bb5302-163a-474b-a3cb-a6b99246c564 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:32.295336 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a5bb5302-163a-474b-a3cb-a6b99246c564 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:32.440188 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a5bb5302-163a-474b-a3cb-a6b99246c564 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:32.448218 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a5bb5302-163a-474b-a3cb-a6b99246c564 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:32.449726 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a5bb5302-163a-474b-a3cb-a6b99246c564 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:32.450888 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a5bb5302-163a-474b-a3cb-a6b99246c564 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.169753 Jun 30 04:20:32.451487 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 315/614] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:32 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:32.804853 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-00ce5c78-12ae-45e1-a8c8-10f5fabd3457 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:32.805582 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-00ce5c78-12ae-45e1-a8c8-10f5fabd3457 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:32.813134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-00ce5c78-12ae-45e1-a8c8-10f5fabd3457 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:32.813647 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-00ce5c78-12ae-45e1-a8c8-10f5fabd3457 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:32.814508 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-00ce5c78-12ae-45e1-a8c8-10f5fabd3457 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:32.815005 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-00ce5c78-12ae-45e1-a8c8-10f5fabd3457 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:32.829583 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c6769c0e-0e84-4edc-a7ba-2b9e2b3c060d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:32.830872 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c6769c0e-0e84-4edc-a7ba-2b9e2b3c060d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:32.838395 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c6769c0e-0e84-4edc-a7ba-2b9e2b3c060d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:32.838986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c6769c0e-0e84-4edc-a7ba-2b9e2b3c060d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:32.839898 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c6769c0e-0e84-4edc-a7ba-2b9e2b3c060d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:32.840397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c6769c0e-0e84-4edc-a7ba-2b9e2b3c060d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:33.025263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-00ce5c78-12ae-45e1-a8c8-10f5fabd3457 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:33.034558 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-00ce5c78-12ae-45e1-a8c8-10f5fabd3457 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.233724 Jun 30 04:20:33.034752 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 300/615] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:32 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:33.038954 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c6769c0e-0e84-4edc-a7ba-2b9e2b3c060d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:33.049361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c6769c0e-0e84-4edc-a7ba-2b9e2b3c060d tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1756 microversion: 2.1 time: 0.223248 Jun 30 04:20:33.050008 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 316/616] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:32 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:33.469891 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-219f040e-2b39-4a02-8ce3-ea79cacecc95 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:33.470517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-219f040e-2b39-4a02-8ce3-ea79cacecc95 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:33.477130 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-219f040e-2b39-4a02-8ce3-ea79cacecc95 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:33.477576 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-219f040e-2b39-4a02-8ce3-ea79cacecc95 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:33.478315 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-219f040e-2b39-4a02-8ce3-ea79cacecc95 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:33.478741 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-219f040e-2b39-4a02-8ce3-ea79cacecc95 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:33.621059 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-219f040e-2b39-4a02-8ce3-ea79cacecc95 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:33.629710 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-219f040e-2b39-4a02-8ce3-ea79cacecc95 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:33.631267 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-219f040e-2b39-4a02-8ce3-ea79cacecc95 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:33.632431 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-219f040e-2b39-4a02-8ce3-ea79cacecc95 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.166514 Jun 30 04:20:33.633095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 301/617] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:33 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:34.056038 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-50b7e8cb-89b9-4fe7-b45f-45410a80330d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:34.056998 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-50b7e8cb-89b9-4fe7-b45f-45410a80330d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:34.068054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-50b7e8cb-89b9-4fe7-b45f-45410a80330d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:34.068797 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-50b7e8cb-89b9-4fe7-b45f-45410a80330d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:34.070050 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-50b7e8cb-89b9-4fe7-b45f-45410a80330d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:34.070453 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4796fd75-eb9f-4e25-845f-745d41d3fdc9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:34.071228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-50b7e8cb-89b9-4fe7-b45f-45410a80330d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:34.071490 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4796fd75-eb9f-4e25-845f-745d41d3fdc9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:34.081884 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4796fd75-eb9f-4e25-845f-745d41d3fdc9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:34.082338 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4796fd75-eb9f-4e25-845f-745d41d3fdc9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:34.083108 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4796fd75-eb9f-4e25-845f-745d41d3fdc9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:34.083598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4796fd75-eb9f-4e25-845f-745d41d3fdc9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:34.273475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-50b7e8cb-89b9-4fe7-b45f-45410a80330d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:34.282130 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-50b7e8cb-89b9-4fe7-b45f-45410a80330d tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.232903 Jun 30 04:20:34.282735 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 317/618] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:34 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:34.286904 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4796fd75-eb9f-4e25-845f-745d41d3fdc9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:34.295028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4796fd75-eb9f-4e25-845f-745d41d3fdc9 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1759 microversion: 2.1 time: 0.231054 Jun 30 04:20:34.295630 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 302/619] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:34 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1759 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:34.655729 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-396139df-1fb2-4250-9604-69b4d67e98b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:34.656725 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-396139df-1fb2-4250-9604-69b4d67e98b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:34.664300 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-396139df-1fb2-4250-9604-69b4d67e98b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:34.664743 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-396139df-1fb2-4250-9604-69b4d67e98b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:34.665497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-396139df-1fb2-4250-9604-69b4d67e98b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:34.665926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-396139df-1fb2-4250-9604-69b4d67e98b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:34.804864 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-396139df-1fb2-4250-9604-69b4d67e98b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:34.813091 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-396139df-1fb2-4250-9604-69b4d67e98b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:34.814587 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-396139df-1fb2-4250-9604-69b4d67e98b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:34.816153 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-396139df-1fb2-4250-9604-69b4d67e98b9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.167238 Jun 30 04:20:34.816721 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 318/620] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:34 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:35.299638 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-390f0aca-8730-4708-bcf8-29a98464a615 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:35.300198 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-390f0aca-8730-4708-bcf8-29a98464a615 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:35.307540 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-390f0aca-8730-4708-bcf8-29a98464a615 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:35.308017 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-390f0aca-8730-4708-bcf8-29a98464a615 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:35.308806 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-390f0aca-8730-4708-bcf8-29a98464a615 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:35.309272 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-390f0aca-8730-4708-bcf8-29a98464a615 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:35.456939 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-390f0aca-8730-4708-bcf8-29a98464a615 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:35.465271 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-390f0aca-8730-4708-bcf8-29a98464a615 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.169968 Jun 30 04:20:35.465854 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 303/621] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:35 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:35.838699 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-51759e39-d188-48bf-a2c7-c86be188a55f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:35.839732 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-51759e39-d188-48bf-a2c7-c86be188a55f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:35.849264 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51759e39-d188-48bf-a2c7-c86be188a55f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:35.849701 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51759e39-d188-48bf-a2c7-c86be188a55f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:35.850448 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51759e39-d188-48bf-a2c7-c86be188a55f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:35.850870 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51759e39-d188-48bf-a2c7-c86be188a55f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:35.982751 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-51759e39-d188-48bf-a2c7-c86be188a55f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:35.990798 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-51759e39-d188-48bf-a2c7-c86be188a55f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:35.992314 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-51759e39-d188-48bf-a2c7-c86be188a55f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:35.993469 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-51759e39-d188-48bf-a2c7-c86be188a55f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.161236 Jun 30 04:20:35.994033 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 319/622] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:35 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:36.487321 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-be1033ba-a141-4ad6-897e-12fd809a4a31 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:36.488145 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-be1033ba-a141-4ad6-897e-12fd809a4a31 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:36.495505 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-be1033ba-a141-4ad6-897e-12fd809a4a31 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:36.495979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-be1033ba-a141-4ad6-897e-12fd809a4a31 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:36.496782 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-be1033ba-a141-4ad6-897e-12fd809a4a31 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:36.497236 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-be1033ba-a141-4ad6-897e-12fd809a4a31 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:36.644046 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-be1033ba-a141-4ad6-897e-12fd809a4a31 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:36.657552 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-be1033ba-a141-4ad6-897e-12fd809a4a31 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.176538 Jun 30 04:20:36.658455 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 304/623] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:36 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:37.015991 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9094965f-8162-4b62-8194-be74c3a12e4a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:37.017057 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9094965f-8162-4b62-8194-be74c3a12e4a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:37.024843 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9094965f-8162-4b62-8194-be74c3a12e4a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:37.025294 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9094965f-8162-4b62-8194-be74c3a12e4a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:37.026053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9094965f-8162-4b62-8194-be74c3a12e4a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:37.026486 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9094965f-8162-4b62-8194-be74c3a12e4a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:37.157822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9094965f-8162-4b62-8194-be74c3a12e4a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:37.170123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9094965f-8162-4b62-8194-be74c3a12e4a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:37.172471 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9094965f-8162-4b62-8194-be74c3a12e4a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:37.174221 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9094965f-8162-4b62-8194-be74c3a12e4a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.164727 Jun 30 04:20:37.175026 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 320/624] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:37 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:37.680358 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ee8c25a4-d8be-4f81-b8cd-debdacb202b8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:37.681300 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ee8c25a4-d8be-4f81-b8cd-debdacb202b8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:37.691891 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee8c25a4-d8be-4f81-b8cd-debdacb202b8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:37.692373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee8c25a4-d8be-4f81-b8cd-debdacb202b8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:37.693144 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee8c25a4-d8be-4f81-b8cd-debdacb202b8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:37.693606 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee8c25a4-d8be-4f81-b8cd-debdacb202b8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:37.830730 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ee8c25a4-d8be-4f81-b8cd-debdacb202b8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:37.839175 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ee8c25a4-d8be-4f81-b8cd-debdacb202b8 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.165807 Jun 30 04:20:37.839762 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 305/625] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:37 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:38.193181 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-dbc0c90b-96ce-4ae4-b80e-553d3b625bc3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:38.193758 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-dbc0c90b-96ce-4ae4-b80e-553d3b625bc3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:38.200980 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dbc0c90b-96ce-4ae4-b80e-553d3b625bc3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:38.201433 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dbc0c90b-96ce-4ae4-b80e-553d3b625bc3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:38.202181 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dbc0c90b-96ce-4ae4-b80e-553d3b625bc3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:38.202618 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dbc0c90b-96ce-4ae4-b80e-553d3b625bc3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:38.344913 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-dbc0c90b-96ce-4ae4-b80e-553d3b625bc3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:38.353480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-dbc0c90b-96ce-4ae4-b80e-553d3b625bc3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:38.355004 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-dbc0c90b-96ce-4ae4-b80e-553d3b625bc3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:38.356201 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-dbc0c90b-96ce-4ae4-b80e-553d3b625bc3 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.167201 Jun 30 04:20:38.356775 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 321/626] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:38 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:38.865375 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-87adbab8-48f5-45a3-8d27-e4f899c4d8e7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:38.865956 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-87adbab8-48f5-45a3-8d27-e4f899c4d8e7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:38.875940 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87adbab8-48f5-45a3-8d27-e4f899c4d8e7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:38.876588 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87adbab8-48f5-45a3-8d27-e4f899c4d8e7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:38.878118 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87adbab8-48f5-45a3-8d27-e4f899c4d8e7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:38.878426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87adbab8-48f5-45a3-8d27-e4f899c4d8e7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:39.025588 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-87adbab8-48f5-45a3-8d27-e4f899c4d8e7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:39.034524 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-87adbab8-48f5-45a3-8d27-e4f899c4d8e7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1737 microversion: 2.1 time: 0.175490 Jun 30 04:20:39.035133 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 306/627] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:38 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:39.378056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6f125ec1-5618-4a79-93fd-3c86ecab17e1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:39.378904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6f125ec1-5618-4a79-93fd-3c86ecab17e1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:39.391840 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6f125ec1-5618-4a79-93fd-3c86ecab17e1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:39.392747 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6f125ec1-5618-4a79-93fd-3c86ecab17e1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:39.393993 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6f125ec1-5618-4a79-93fd-3c86ecab17e1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:39.394428 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6f125ec1-5618-4a79-93fd-3c86ecab17e1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:39.545600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6f125ec1-5618-4a79-93fd-3c86ecab17e1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:39.554123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6f125ec1-5618-4a79-93fd-3c86ecab17e1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:39.555663 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6f125ec1-5618-4a79-93fd-3c86ecab17e1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:39.556812 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6f125ec1-5618-4a79-93fd-3c86ecab17e1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.185415 Jun 30 04:20:39.557407 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 322/628] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:39 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:40.056577 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f6b4131f-0ba9-47b6-ae8b-35ab9df565e9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:40.057501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f6b4131f-0ba9-47b6-ae8b-35ab9df565e9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:40.069674 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f6b4131f-0ba9-47b6-ae8b-35ab9df565e9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:40.070477 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f6b4131f-0ba9-47b6-ae8b-35ab9df565e9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:40.071811 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f6b4131f-0ba9-47b6-ae8b-35ab9df565e9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:40.072512 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f6b4131f-0ba9-47b6-ae8b-35ab9df565e9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:40.214732 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f6b4131f-0ba9-47b6-ae8b-35ab9df565e9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:40.227575 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f6b4131f-0ba9-47b6-ae8b-35ab9df565e9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1717 microversion: 2.1 time: 0.177778 Jun 30 04:20:40.228356 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 307/629] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:40 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:40.342446 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-33517199-424e-4a5d-a628-1c3d35148a5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:40.342945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-33517199-424e-4a5d-a628-1c3d35148a5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:40.349610 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-33517199-424e-4a5d-a628-1c3d35148a5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:40.350160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-33517199-424e-4a5d-a628-1c3d35148a5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:40.350914 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-33517199-424e-4a5d-a628-1c3d35148a5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:40.351372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-33517199-424e-4a5d-a628-1c3d35148a5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:40.437856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-33517199-424e-4a5d-a628-1c3d35148a5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] HTTP exception thrown: Cannot 'detach_volume' instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 while it is in vm_state rescued Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-33517199-424e-4a5d-a628-1c3d35148a5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Request method failure captured: Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: DELETE /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments/41fca21a-168a-48a8-89de-222250bd56c2 HTTP/1.1 Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSOgW5TdQdIDnKRvRN6OMIhpIxAn2TKObfMVZ_JlbTYawaWtUqJSBAcUwPpiMbmhabkYxhVFA8mAfsXKkBB-sLhYFC6mMr2p3YJrMJjtEXUPxpHpeI0lkKEnL1xpp2Dw8Df0bDRkrrlKKYAeqTbtfqBunbiYcSLFxb4qb3NxzJ1LYcs Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 74b53f46d15c4465b9005939114e67a3 Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:20:40.439558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74b53f46d15c4465b9005939114e67a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_74b53f46d15c4465b9005939114e67a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74b53f46d15c4465b9005939114e67a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/74b53f46d15c4465b9005939114e67a3"}]}] Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 74b53f46d15c4465b9005939114e67a3 Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-ServerRescueNegativeTestJSON-1003299466-project Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: b6854699a1dc475ab11a89bcaf2af85a Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1003299466-project Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:20:40.441241 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Cannot 'detach_volume' instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 while it is in vm_state rescued Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'server_id': '8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99', 'id': '41fca21a-168a-48a8-89de-222250bd56c2'} Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:20:40.442287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 while it is in vm_state rescued Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 while it is in vm_state rescued Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:20:40.444040 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-33517199-424e-4a5d-a628-1c3d35148a5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Returning 409 to user: Cannot 'detach_volume' instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 while it is in vm_state rescued {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:20:40.445619 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-33517199-424e-4a5d-a628-1c3d35148a5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments/41fca21a-168a-48a8-89de-222250bd56c2" status: 409 len: 152 microversion: 2.1 time: 0.102808 Jun 30 04:20:40.445619 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 323/630] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:20:40 2022] DELETE /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments/41fca21a-168a-48a8-89de-222250bd56c2 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 04:20:40.450667 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0f868619-3dcc-44b4-bc3a-aceb676cf3a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:20:40.451239 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0f868619-3dcc-44b4-bc3a-aceb676cf3a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:40.457482 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0f868619-3dcc-44b4-bc3a-aceb676cf3a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:40.457929 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0f868619-3dcc-44b4-bc3a-aceb676cf3a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:40.458684 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0f868619-3dcc-44b4-bc3a-aceb676cf3a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:40.459127 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0f868619-3dcc-44b4-bc3a-aceb676cf3a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:40.533606 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0f868619-3dcc-44b4-bc3a-aceb676cf3a0 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "POST /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/action" status: 202 len: 0 microversion: 2.1 time: 0.086921 Jun 30 04:20:40.534297 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 308/631] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:20:40 2022] POST /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:20:40.542677 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-730d055a-cba1-46e7-a93a-f473d5ee5fa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:40.543313 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-730d055a-cba1-46e7-a93a-f473d5ee5fa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:40.550578 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-730d055a-cba1-46e7-a93a-f473d5ee5fa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:40.551015 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-730d055a-cba1-46e7-a93a-f473d5ee5fa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:40.551815 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-730d055a-cba1-46e7-a93a-f473d5ee5fa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:40.552245 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-730d055a-cba1-46e7-a93a-f473d5ee5fa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:40.578077 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c8c0517d-f0ec-4c81-984b-d9431972379e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:40.578773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c8c0517d-f0ec-4c81-984b-d9431972379e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:40.585914 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8c0517d-f0ec-4c81-984b-d9431972379e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:40.586303 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8c0517d-f0ec-4c81-984b-d9431972379e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:40.587066 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8c0517d-f0ec-4c81-984b-d9431972379e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:40.587540 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8c0517d-f0ec-4c81-984b-d9431972379e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:40.864268 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-730d055a-cba1-46e7-a93a-f473d5ee5fa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:40.872970 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-730d055a-cba1-46e7-a93a-f473d5ee5fa2 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1725 microversion: 2.1 time: 0.334144 Jun 30 04:20:40.874326 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 324/632] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:40 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:40.876655 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c8c0517d-f0ec-4c81-984b-d9431972379e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:40.880876 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:20:40.887767 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c8c0517d-f0ec-4c81-984b-d9431972379e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:40.889647 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c8c0517d-f0ec-4c81-984b-d9431972379e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:40.890842 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c8c0517d-f0ec-4c81-984b-d9431972379e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.317130 Jun 30 04:20:40.891696 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 309/633] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:40 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:20:41.891503 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-933dac88-c0bb-47a6-9b9b-dd2890475a05 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:41.892077 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-933dac88-c0bb-47a6-9b9b-dd2890475a05 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:41.899132 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-933dac88-c0bb-47a6-9b9b-dd2890475a05 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:41.899589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-933dac88-c0bb-47a6-9b9b-dd2890475a05 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:41.900348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-933dac88-c0bb-47a6-9b9b-dd2890475a05 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:41.900785 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-933dac88-c0bb-47a6-9b9b-dd2890475a05 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:41.909773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ef0590ad-3275-44cf-a556-9f44c548dbff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:41.910458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ef0590ad-3275-44cf-a556-9f44c548dbff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:41.918549 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef0590ad-3275-44cf-a556-9f44c548dbff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:41.918961 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef0590ad-3275-44cf-a556-9f44c548dbff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:41.919757 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef0590ad-3275-44cf-a556-9f44c548dbff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:41.920184 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef0590ad-3275-44cf-a556-9f44c548dbff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:42.098652 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-933dac88-c0bb-47a6-9b9b-dd2890475a05 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:42.107058 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-933dac88-c0bb-47a6-9b9b-dd2890475a05 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1725 microversion: 2.1 time: 0.219671 Jun 30 04:20:42.107859 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 325/634] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:41 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:42.110128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ef0590ad-3275-44cf-a556-9f44c548dbff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:42.118375 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ef0590ad-3275-44cf-a556-9f44c548dbff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:42.119893 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ef0590ad-3275-44cf-a556-9f44c548dbff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:42.121061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ef0590ad-3275-44cf-a556-9f44c548dbff tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.215360 Jun 30 04:20:42.121615 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 310/635] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:41 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:20:43.128764 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-91d29046-87fa-4960-8923-a2a985724744 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:43.129641 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-91d29046-87fa-4960-8923-a2a985724744 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:43.140588 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-91d29046-87fa-4960-8923-a2a985724744 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:43.141332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-91d29046-87fa-4960-8923-a2a985724744 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:43.142557 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-91d29046-87fa-4960-8923-a2a985724744 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:43.143232 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec3a969c-07ca-4084-ba14-10ea92dbcb0f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:43.143945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-91d29046-87fa-4960-8923-a2a985724744 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:43.144302 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ec3a969c-07ca-4084-ba14-10ea92dbcb0f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:43.151080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec3a969c-07ca-4084-ba14-10ea92dbcb0f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:43.151556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec3a969c-07ca-4084-ba14-10ea92dbcb0f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:43.152308 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec3a969c-07ca-4084-ba14-10ea92dbcb0f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:43.153116 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec3a969c-07ca-4084-ba14-10ea92dbcb0f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:43.344069 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-91d29046-87fa-4960-8923-a2a985724744 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:43.348104 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ec3a969c-07ca-4084-ba14-10ea92dbcb0f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:43.352365 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-91d29046-87fa-4960-8923-a2a985724744 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1731 microversion: 2.1 time: 0.230367 Jun 30 04:20:43.352982 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 326/636] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:20:43 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:20:43.356817 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ec3a969c-07ca-4084-ba14-10ea92dbcb0f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:43.358370 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ec3a969c-07ca-4084-ba14-10ea92dbcb0f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:43.359582 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ec3a969c-07ca-4084-ba14-10ea92dbcb0f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.223234 Jun 30 04:20:43.360286 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 311/637] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:43 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:43.369688 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b31ed6d8-ed41-4843-a5b3-1160585a95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:43.370329 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b31ed6d8-ed41-4843-a5b3-1160585a95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:43.377006 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b31ed6d8-ed41-4843-a5b3-1160585a95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:43.377448 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b31ed6d8-ed41-4843-a5b3-1160585a95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:43.378216 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b31ed6d8-ed41-4843-a5b3-1160585a95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:43.378642 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b31ed6d8-ed41-4843-a5b3-1160585a95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:43.459711 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b31ed6d8-ed41-4843-a5b3-1160585a95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093745 Jun 30 04:20:43.460322 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 327/638] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 30 04:20:43 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:20:44.378216 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ca6f5ffe-e87c-4a36-988d-9575509c154f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:44.379119 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ca6f5ffe-e87c-4a36-988d-9575509c154f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:44.391539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca6f5ffe-e87c-4a36-988d-9575509c154f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:44.392359 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca6f5ffe-e87c-4a36-988d-9575509c154f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:44.393330 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca6f5ffe-e87c-4a36-988d-9575509c154f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:44.394005 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca6f5ffe-e87c-4a36-988d-9575509c154f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:44.429717 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-0e01d9c6-4627-44ed-8fca-30fe3ea87c5a req-7b1ee915-7d7e-4f79-a172-a29d32fb8ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99", "tag": "2a4fd84e-fb19-4d1c-b772-2251c8322151"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:20:44.433563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=59 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:20:44.440260 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-0e01d9c6-4627-44ed-8fca-30fe3ea87c5a req-7b1ee915-7d7e-4f79-a172-a29d32fb8ec9 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:44.440810 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-0e01d9c6-4627-44ed-8fca-30fe3ea87c5a req-7b1ee915-7d7e-4f79-a172-a29d32fb8ec9 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:44.452791 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-0e01d9c6-4627-44ed-8fca-30fe3ea87c5a req-7b1ee915-7d7e-4f79-a172-a29d32fb8ec9 service nova] Creating event network-changed:2a4fd84e-fb19-4d1c-b772-2251c8322151 for instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 on hv-cinder-84684 Jun 30 04:20:44.458846 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-0e01d9c6-4627-44ed-8fca-30fe3ea87c5a req-7b1ee915-7d7e-4f79-a172-a29d32fb8ec9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103436 Jun 30 04:20:44.459519 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 312/639] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:20:44.586507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ca6f5ffe-e87c-4a36-988d-9575509c154f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:44.595498 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ca6f5ffe-e87c-4a36-988d-9575509c154f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:44.597195 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ca6f5ffe-e87c-4a36-988d-9575509c154f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:44.598490 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ca6f5ffe-e87c-4a36-988d-9575509c154f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.224586 Jun 30 04:20:44.599194 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 328/640] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:44 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:45.622383 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-77b7999a-ff36-4958-8dd3-96fb9be1dd66 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:45.623185 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-77b7999a-ff36-4958-8dd3-96fb9be1dd66 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:45.632489 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-77b7999a-ff36-4958-8dd3-96fb9be1dd66 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:45.632938 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-77b7999a-ff36-4958-8dd3-96fb9be1dd66 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:45.633728 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-77b7999a-ff36-4958-8dd3-96fb9be1dd66 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:45.634158 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-77b7999a-ff36-4958-8dd3-96fb9be1dd66 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:45.786525 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-77b7999a-ff36-4958-8dd3-96fb9be1dd66 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:45.794879 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-77b7999a-ff36-4958-8dd3-96fb9be1dd66 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:45.796454 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-77b7999a-ff36-4958-8dd3-96fb9be1dd66 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:45.797621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-77b7999a-ff36-4958-8dd3-96fb9be1dd66 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1745 microversion: 2.20 time: 0.182491 Jun 30 04:20:45.798160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 313/641] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:45 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:46.475615 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-be731f89-1736-4e56-9328-3b0a11e822a0 req-0b757688-be8e-4ede-95e1-9f259930fb4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99", "tag": "2a4fd84e-fb19-4d1c-b772-2251c8322151"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:20:46.484756 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-be731f89-1736-4e56-9328-3b0a11e822a0 req-0b757688-be8e-4ede-95e1-9f259930fb4a service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:46.485194 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-be731f89-1736-4e56-9328-3b0a11e822a0 req-0b757688-be8e-4ede-95e1-9f259930fb4a service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:46.498347 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-be731f89-1736-4e56-9328-3b0a11e822a0 req-0b757688-be8e-4ede-95e1-9f259930fb4a service nova] Creating event network-changed:2a4fd84e-fb19-4d1c-b772-2251c8322151 for instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 on hv-cinder-84684 Jun 30 04:20:46.503771 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-be731f89-1736-4e56-9328-3b0a11e822a0 req-0b757688-be8e-4ede-95e1-9f259930fb4a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032307 Jun 30 04:20:46.504319 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 329/642] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:20:46.816748 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ac73b90d-6554-4751-854f-fe5828541ea8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:46.817759 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ac73b90d-6554-4751-854f-fe5828541ea8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:46.825007 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ac73b90d-6554-4751-854f-fe5828541ea8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:46.825455 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ac73b90d-6554-4751-854f-fe5828541ea8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:46.826265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ac73b90d-6554-4751-854f-fe5828541ea8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:46.826695 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ac73b90d-6554-4751-854f-fe5828541ea8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:47.156958 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ac73b90d-6554-4751-854f-fe5828541ea8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:47.165455 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ac73b90d-6554-4751-854f-fe5828541ea8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:47.167150 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ac73b90d-6554-4751-854f-fe5828541ea8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:47.168699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ac73b90d-6554-4751-854f-fe5828541ea8 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1745 microversion: 2.20 time: 0.355825 Jun 30 04:20:47.179699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 314/643] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:46 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1745 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:48.188461 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3dfc7d0d-88b8-434c-90cb-428a109297de tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:48.189985 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3dfc7d0d-88b8-434c-90cb-428a109297de tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:48.192410 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=63 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:20:48.199074 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3dfc7d0d-88b8-434c-90cb-428a109297de tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:48.199758 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3dfc7d0d-88b8-434c-90cb-428a109297de tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:48.200593 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3dfc7d0d-88b8-434c-90cb-428a109297de tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:48.201078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3dfc7d0d-88b8-434c-90cb-428a109297de tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:48.358878 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3dfc7d0d-88b8-434c-90cb-428a109297de tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:48.367623 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3dfc7d0d-88b8-434c-90cb-428a109297de tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:48.369251 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3dfc7d0d-88b8-434c-90cb-428a109297de tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:48.370554 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3dfc7d0d-88b8-434c-90cb-428a109297de tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1740 microversion: 2.20 time: 0.187517 Jun 30 04:20:48.371218 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 330/644] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:48 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:49.163714 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-09c5511e-194f-4680-ab67-841c9d83f28a req-0f8fd2a5-58dd-44f3-9b6f-8eb7f9a96386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a344d61b-2dbc-49a8-b5c1-4d5619af3e77", "name": "network-vif-plugged", "status": "completed", "tag": "14e3c353-ee55-4eee-8bdc-9d20ccd23a9e"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:20:49.173259 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-09c5511e-194f-4680-ab67-841c9d83f28a req-0f8fd2a5-58dd-44f3-9b6f-8eb7f9a96386 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:49.173671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-09c5511e-194f-4680-ab67-841c9d83f28a req-0f8fd2a5-58dd-44f3-9b6f-8eb7f9a96386 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:49.187815 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-09c5511e-194f-4680-ab67-841c9d83f28a req-0f8fd2a5-58dd-44f3-9b6f-8eb7f9a96386 service nova] Creating event network-vif-plugged:14e3c353-ee55-4eee-8bdc-9d20ccd23a9e for instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 on hv-cinder-84684 Jun 30 04:20:49.193466 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-09c5511e-194f-4680-ab67-841c9d83f28a req-0f8fd2a5-58dd-44f3-9b6f-8eb7f9a96386 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102264 Jun 30 04:20:49.194404 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 315/645] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:20:49.390694 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7c075886-9d12-4ba1-a990-d889ae3f1401 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:49.391400 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7c075886-9d12-4ba1-a990-d889ae3f1401 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:49.398115 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7c075886-9d12-4ba1-a990-d889ae3f1401 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:49.398551 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7c075886-9d12-4ba1-a990-d889ae3f1401 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:49.399382 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7c075886-9d12-4ba1-a990-d889ae3f1401 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:49.400001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7c075886-9d12-4ba1-a990-d889ae3f1401 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:49.550430 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7c075886-9d12-4ba1-a990-d889ae3f1401 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:49.562272 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7c075886-9d12-4ba1-a990-d889ae3f1401 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:49.563933 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7c075886-9d12-4ba1-a990-d889ae3f1401 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:49.565111 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7c075886-9d12-4ba1-a990-d889ae3f1401 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1740 microversion: 2.20 time: 0.179294 Jun 30 04:20:49.565667 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 331/646] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:49 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:50.589200 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c60c1739-4aec-475a-bd85-b59f9ea582a5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:50.590192 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c60c1739-4aec-475a-bd85-b59f9ea582a5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:50.597261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c60c1739-4aec-475a-bd85-b59f9ea582a5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:50.597706 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c60c1739-4aec-475a-bd85-b59f9ea582a5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:50.598614 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c60c1739-4aec-475a-bd85-b59f9ea582a5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:50.599155 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c60c1739-4aec-475a-bd85-b59f9ea582a5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:50.751506 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c60c1739-4aec-475a-bd85-b59f9ea582a5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:50.760582 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c60c1739-4aec-475a-bd85-b59f9ea582a5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:50.762446 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c60c1739-4aec-475a-bd85-b59f9ea582a5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:50.763783 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c60c1739-4aec-475a-bd85-b59f9ea582a5 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1740 microversion: 2.20 time: 0.178996 Jun 30 04:20:50.764577 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 316/647] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:50 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:51.783385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5edc5651-0966-4aeb-aa72-57d06a8100d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:51.784845 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5edc5651-0966-4aeb-aa72-57d06a8100d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:51.792774 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5edc5651-0966-4aeb-aa72-57d06a8100d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:51.793327 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5edc5651-0966-4aeb-aa72-57d06a8100d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:51.794152 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5edc5651-0966-4aeb-aa72-57d06a8100d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:51.794652 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5edc5651-0966-4aeb-aa72-57d06a8100d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:51.819423 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=100 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:20:51.933766 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5edc5651-0966-4aeb-aa72-57d06a8100d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:51.942013 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5edc5651-0966-4aeb-aa72-57d06a8100d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:51.943695 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5edc5651-0966-4aeb-aa72-57d06a8100d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:51.944871 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5edc5651-0966-4aeb-aa72-57d06a8100d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1740 microversion: 2.20 time: 0.166505 Jun 30 04:20:51.955817 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 332/648] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:51 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:52.963846 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-54c532e2-2581-4730-be93-575d09b2ccc4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:52.964465 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-54c532e2-2581-4730-be93-575d09b2ccc4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:52.972305 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54c532e2-2581-4730-be93-575d09b2ccc4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:52.972759 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54c532e2-2581-4730-be93-575d09b2ccc4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:52.973552 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54c532e2-2581-4730-be93-575d09b2ccc4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:52.974018 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54c532e2-2581-4730-be93-575d09b2ccc4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:53.123358 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-54c532e2-2581-4730-be93-575d09b2ccc4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:53.132179 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-54c532e2-2581-4730-be93-575d09b2ccc4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:53.133700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-54c532e2-2581-4730-be93-575d09b2ccc4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:53.134868 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-54c532e2-2581-4730-be93-575d09b2ccc4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1740 microversion: 2.20 time: 0.175204 Jun 30 04:20:53.135720 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 317/649] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:52 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:54.156681 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-2d7ec99a-b817-468b-ad37-12fbf0133493 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:54.157581 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-2d7ec99a-b817-468b-ad37-12fbf0133493 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:54.168900 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2d7ec99a-b817-468b-ad37-12fbf0133493 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:54.170178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2d7ec99a-b817-468b-ad37-12fbf0133493 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:54.171520 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2d7ec99a-b817-468b-ad37-12fbf0133493 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:54.171951 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2d7ec99a-b817-468b-ad37-12fbf0133493 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:54.352709 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-2d7ec99a-b817-468b-ad37-12fbf0133493 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:54.361029 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-2d7ec99a-b817-468b-ad37-12fbf0133493 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:54.362606 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-2d7ec99a-b817-468b-ad37-12fbf0133493 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:54.365665 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-2d7ec99a-b817-468b-ad37-12fbf0133493 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1740 microversion: 2.20 time: 0.213661 Jun 30 04:20:54.377187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 333/650] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:54 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:55.384793 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e7b36bee-c0a7-4f6c-af64-ea6a749db26a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:55.385394 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e7b36bee-c0a7-4f6c-af64-ea6a749db26a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:55.393166 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7b36bee-c0a7-4f6c-af64-ea6a749db26a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:55.393393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7b36bee-c0a7-4f6c-af64-ea6a749db26a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:55.394092 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7b36bee-c0a7-4f6c-af64-ea6a749db26a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:55.394521 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7b36bee-c0a7-4f6c-af64-ea6a749db26a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:55.540861 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7b36bee-c0a7-4f6c-af64-ea6a749db26a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:55.549569 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7b36bee-c0a7-4f6c-af64-ea6a749db26a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:55.551076 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7b36bee-c0a7-4f6c-af64-ea6a749db26a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:55.552621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e7b36bee-c0a7-4f6c-af64-ea6a749db26a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1740 microversion: 2.20 time: 0.172047 Jun 30 04:20:55.553203 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 318/651] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:55 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:56.572345 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c568fa39-436a-4bc2-bcad-a01f54bedecb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:56.572971 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c568fa39-436a-4bc2-bcad-a01f54bedecb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:56.579709 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c568fa39-436a-4bc2-bcad-a01f54bedecb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:56.580166 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c568fa39-436a-4bc2-bcad-a01f54bedecb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:56.580978 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c568fa39-436a-4bc2-bcad-a01f54bedecb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:56.581412 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c568fa39-436a-4bc2-bcad-a01f54bedecb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:56.720704 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c568fa39-436a-4bc2-bcad-a01f54bedecb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:56.733439 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c568fa39-436a-4bc2-bcad-a01f54bedecb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:56.735745 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c568fa39-436a-4bc2-bcad-a01f54bedecb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:56.737368 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c568fa39-436a-4bc2-bcad-a01f54bedecb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1740 microversion: 2.20 time: 0.169044 Jun 30 04:20:56.738132 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 334/652] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:56 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:57.759214 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-422b7b8d-974f-4ce2-947d-3499831c3b3c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:57.759892 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-422b7b8d-974f-4ce2-947d-3499831c3b3c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:57.767359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-422b7b8d-974f-4ce2-947d-3499831c3b3c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:57.767891 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-422b7b8d-974f-4ce2-947d-3499831c3b3c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:57.768776 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-422b7b8d-974f-4ce2-947d-3499831c3b3c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:57.769283 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-422b7b8d-974f-4ce2-947d-3499831c3b3c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:57.904066 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-422b7b8d-974f-4ce2-947d-3499831c3b3c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:57.913372 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-422b7b8d-974f-4ce2-947d-3499831c3b3c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:57.915139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-422b7b8d-974f-4ce2-947d-3499831c3b3c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:57.916344 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-422b7b8d-974f-4ce2-947d-3499831c3b3c tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1722 microversion: 2.20 time: 0.162562 Jun 30 04:20:57.916889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 319/653] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:57 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:20:58.943035 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fd58681f-e8ec-41fc-9eb5-34551681514f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:20:58.943942 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fd58681f-e8ec-41fc-9eb5-34551681514f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:20:58.955087 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd58681f-e8ec-41fc-9eb5-34551681514f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:58.955852 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd58681f-e8ec-41fc-9eb5-34551681514f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:58.957119 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd58681f-e8ec-41fc-9eb5-34551681514f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:20:58.957872 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fd58681f-e8ec-41fc-9eb5-34551681514f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:20:59.102007 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fd58681f-e8ec-41fc-9eb5-34551681514f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:59.110511 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fd58681f-e8ec-41fc-9eb5-34551681514f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:59.112062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fd58681f-e8ec-41fc-9eb5-34551681514f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:20:59.113243 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fd58681f-e8ec-41fc-9eb5-34551681514f tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1722 microversion: 2.20 time: 0.176888 Jun 30 04:20:59.113861 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 335/654] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:20:58 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:00.140253 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9792fc7e-76ab-4e56-b8b7-864cc5c0b20d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:00.141239 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9792fc7e-76ab-4e56-b8b7-864cc5c0b20d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:00.153163 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9792fc7e-76ab-4e56-b8b7-864cc5c0b20d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:00.153936 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9792fc7e-76ab-4e56-b8b7-864cc5c0b20d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:00.155183 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9792fc7e-76ab-4e56-b8b7-864cc5c0b20d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:00.155852 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9792fc7e-76ab-4e56-b8b7-864cc5c0b20d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:00.311016 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9792fc7e-76ab-4e56-b8b7-864cc5c0b20d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:00.319478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9792fc7e-76ab-4e56-b8b7-864cc5c0b20d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:00.320978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9792fc7e-76ab-4e56-b8b7-864cc5c0b20d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:00.322130 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9792fc7e-76ab-4e56-b8b7-864cc5c0b20d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1665 microversion: 2.20 time: 0.188486 Jun 30 04:21:00.322712 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 320/655] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:00 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1665 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:00.340386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-66204770-e976-499c-8b38-5d5c90f179f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f2d0e20-3cbd-4182-bdaf-eb13418fa3c9"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:00.341431 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-66204770-e976-499c-8b38-5d5c90f179f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:00.348086 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-66204770-e976-499c-8b38-5d5c90f179f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:00.348543 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-66204770-e976-499c-8b38-5d5c90f179f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:00.349283 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-66204770-e976-499c-8b38-5d5c90f179f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:00.349733 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-66204770-e976-499c-8b38-5d5c90f179f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:00.660409 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-66204770-e976-499c-8b38-5d5c90f179f0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "POST /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323906 Jun 30 04:21:00.661238 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 336/656] 10.222.0.13 () {62 vars in 1363 bytes} [Thu Jun 30 04:21:00 2022] POST /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 04:21:00.778099 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cc637bd2-f1f4-444f-9f10-4da174c5b1ca tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:00.778585 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-cc637bd2-f1f4-444f-9f10-4da174c5b1ca tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:00.785017 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cc637bd2-f1f4-444f-9f10-4da174c5b1ca tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:00.785517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cc637bd2-f1f4-444f-9f10-4da174c5b1ca tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:00.786299 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cc637bd2-f1f4-444f-9f10-4da174c5b1ca tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:00.786721 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cc637bd2-f1f4-444f-9f10-4da174c5b1ca tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:01.073804 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cc637bd2-f1f4-444f-9f10-4da174c5b1ca tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/os-volume_attachments/7f2d0e20-3cbd-4182-bdaf-eb13418fa3c9" status: 202 len: 0 microversion: 2.20 time: 0.299995 Jun 30 04:21:01.074609 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 321/657] 10.222.0.13 () {60 vars in 1456 bytes} [Thu Jun 30 04:21:00 2022] DELETE /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/os-volume_attachments/7f2d0e20-3cbd-4182-bdaf-eb13418fa3c9 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:21:01.075008 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-c8c0f9f7-1602-4d56-9139-a70bcfcb162c req-2d83ba6e-43f0-4b25-bf4d-e05332a5eb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a344d61b-2dbc-49a8-b5c1-4d5619af3e77", "name": "network-vif-unplugged", "status": "completed", "tag": "14e3c353-ee55-4eee-8bdc-9d20ccd23a9e"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:01.087763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-c8c0f9f7-1602-4d56-9139-a70bcfcb162c req-2d83ba6e-43f0-4b25-bf4d-e05332a5eb79 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:01.088206 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-c8c0f9f7-1602-4d56-9139-a70bcfcb162c req-2d83ba6e-43f0-4b25-bf4d-e05332a5eb79 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:01.099351 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.compute.server_external_events [req-c8c0f9f7-1602-4d56-9139-a70bcfcb162c req-2d83ba6e-43f0-4b25-bf4d-e05332a5eb79 service nova] Unable to find a host for instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77. Dropping event network-vif-unplugged {{(pid=118188) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 04:21:01.100280 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-c8c0f9f7-1602-4d56-9139-a70bcfcb162c req-2d83ba6e-43f0-4b25-bf4d-e05332a5eb79 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030023 Jun 30 04:21:01.101093 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 337/658] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 30 04:21:01.135136 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-22775342-d88b-411e-a2fa-04ec60e0bcd2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:01.135465 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-22775342-d88b-411e-a2fa-04ec60e0bcd2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:01.142502 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-22775342-d88b-411e-a2fa-04ec60e0bcd2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:01.143085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-22775342-d88b-411e-a2fa-04ec60e0bcd2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:01.143721 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-22775342-d88b-411e-a2fa-04ec60e0bcd2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:01.144139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-22775342-d88b-411e-a2fa-04ec60e0bcd2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:01.297856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-22775342-d88b-411e-a2fa-04ec60e0bcd2 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "POST /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/action" status: 202 len: 0 microversion: 2.20 time: 0.166957 Jun 30 04:21:01.298955 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 322/659] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 30 04:21:01 2022] POST /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:21:01.306948 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e167a992-dca7-42a5-b329-c99e850ebece tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:01.307807 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e167a992-dca7-42a5-b329-c99e850ebece tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:01.313931 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e167a992-dca7-42a5-b329-c99e850ebece tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:01.314321 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e167a992-dca7-42a5-b329-c99e850ebece tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:01.315204 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e167a992-dca7-42a5-b329-c99e850ebece tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:01.315635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e167a992-dca7-42a5-b329-c99e850ebece tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:01.451384 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e167a992-dca7-42a5-b329-c99e850ebece tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:01.459975 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e167a992-dca7-42a5-b329-c99e850ebece tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:01.461425 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e167a992-dca7-42a5-b329-c99e850ebece tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:01.462597 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e167a992-dca7-42a5-b329-c99e850ebece tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1673 microversion: 2.20 time: 0.159519 Jun 30 04:21:01.463530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 338/660] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:01 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:02.482349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-197b2e81-f3c5-415c-8814-d13d38b74983 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:02.482974 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-197b2e81-f3c5-415c-8814-d13d38b74983 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:02.490422 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-197b2e81-f3c5-415c-8814-d13d38b74983 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:02.490866 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-197b2e81-f3c5-415c-8814-d13d38b74983 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:02.491656 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-197b2e81-f3c5-415c-8814-d13d38b74983 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:02.492094 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-197b2e81-f3c5-415c-8814-d13d38b74983 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:02.624321 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-197b2e81-f3c5-415c-8814-d13d38b74983 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:02.632507 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-197b2e81-f3c5-415c-8814-d13d38b74983 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:02.634003 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-197b2e81-f3c5-415c-8814-d13d38b74983 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:02.635201 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-197b2e81-f3c5-415c-8814-d13d38b74983 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1675 microversion: 2.20 time: 0.157369 Jun 30 04:21:02.635791 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 323/661] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:02 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:03.268170 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-38e8a158-34d6-4c72-b0e4-3f386e5ef2c3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:03.268730 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-38e8a158-34d6-4c72-b0e4-3f386e5ef2c3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:03.275972 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-38e8a158-34d6-4c72-b0e4-3f386e5ef2c3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:03.276418 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-38e8a158-34d6-4c72-b0e4-3f386e5ef2c3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:03.277507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-38e8a158-34d6-4c72-b0e4-3f386e5ef2c3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:03.277927 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-38e8a158-34d6-4c72-b0e4-3f386e5ef2c3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:03.301349 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-38e8a158-34d6-4c72-b0e4-3f386e5ef2c3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lazy-loading 'flavor' on Instance uuid 51354e88-a19f-433f-85b3-126269c921c4 {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:21:03.376246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-38e8a158-34d6-4c72-b0e4-3f386e5ef2c3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "POST /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4/action" status: 202 len: 0 microversion: 2.1 time: 0.111778 Jun 30 04:21:03.376836 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 339/662] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:21:03 2022] POST /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:21:03.385363 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cb6480b8-c075-458b-9d22-5e4928b485cf tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:03.386578 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-cb6480b8-c075-458b-9d22-5e4928b485cf tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:03.394270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cb6480b8-c075-458b-9d22-5e4928b485cf tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:03.394968 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cb6480b8-c075-458b-9d22-5e4928b485cf tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:03.396161 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cb6480b8-c075-458b-9d22-5e4928b485cf tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:03.396919 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cb6480b8-c075-458b-9d22-5e4928b485cf tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:03.417477 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:03.552774 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-cb6480b8-c075-458b-9d22-5e4928b485cf tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:03.560787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cb6480b8-c075-458b-9d22-5e4928b485cf tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.179333 Jun 30 04:21:03.561359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 324/663] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:03 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:03.655425 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b0a4a1ca-1e4c-42a3-8f64-9c80832f161d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:03.656108 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b0a4a1ca-1e4c-42a3-8f64-9c80832f161d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:03.662647 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b0a4a1ca-1e4c-42a3-8f64-9c80832f161d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:03.663087 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b0a4a1ca-1e4c-42a3-8f64-9c80832f161d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:03.663866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b0a4a1ca-1e4c-42a3-8f64-9c80832f161d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:03.664333 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b0a4a1ca-1e4c-42a3-8f64-9c80832f161d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:03.803504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b0a4a1ca-1e4c-42a3-8f64-9c80832f161d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:03.811910 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b0a4a1ca-1e4c-42a3-8f64-9c80832f161d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:03.813472 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b0a4a1ca-1e4c-42a3-8f64-9c80832f161d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:03.814890 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b0a4a1ca-1e4c-42a3-8f64-9c80832f161d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.164271 Jun 30 04:21:03.815458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 340/664] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:03 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:04.578852 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c6d26c04-0bc3-4e41-b1c2-85e948789d26 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:04.580097 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c6d26c04-0bc3-4e41-b1c2-85e948789d26 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:04.587850 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c6d26c04-0bc3-4e41-b1c2-85e948789d26 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:04.588293 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c6d26c04-0bc3-4e41-b1c2-85e948789d26 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:04.589059 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c6d26c04-0bc3-4e41-b1c2-85e948789d26 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:04.589480 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c6d26c04-0bc3-4e41-b1c2-85e948789d26 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:04.738245 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c6d26c04-0bc3-4e41-b1c2-85e948789d26 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:04.747634 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c6d26c04-0bc3-4e41-b1c2-85e948789d26 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.173342 Jun 30 04:21:04.748607 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 325/665] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:04 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:04.836757 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cef1853d-a6d5-45fe-9d79-ab4542d0ba22 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:04.837401 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cef1853d-a6d5-45fe-9d79-ab4542d0ba22 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:04.844961 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cef1853d-a6d5-45fe-9d79-ab4542d0ba22 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:04.845564 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cef1853d-a6d5-45fe-9d79-ab4542d0ba22 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:04.846567 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cef1853d-a6d5-45fe-9d79-ab4542d0ba22 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:04.847008 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cef1853d-a6d5-45fe-9d79-ab4542d0ba22 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:04.985702 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cef1853d-a6d5-45fe-9d79-ab4542d0ba22 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:04.994762 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cef1853d-a6d5-45fe-9d79-ab4542d0ba22 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:04.996379 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cef1853d-a6d5-45fe-9d79-ab4542d0ba22 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:04.997753 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cef1853d-a6d5-45fe-9d79-ab4542d0ba22 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.166387 Jun 30 04:21:04.998388 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 341/666] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:04 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:05.765396 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-34dc72cc-dd64-4096-97de-6767edf4cd6b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:05.766105 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-34dc72cc-dd64-4096-97de-6767edf4cd6b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:05.773192 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-34dc72cc-dd64-4096-97de-6767edf4cd6b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:05.773644 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-34dc72cc-dd64-4096-97de-6767edf4cd6b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:05.774423 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-34dc72cc-dd64-4096-97de-6767edf4cd6b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:05.774859 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-34dc72cc-dd64-4096-97de-6767edf4cd6b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:05.918952 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-34dc72cc-dd64-4096-97de-6767edf4cd6b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:05.926675 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-34dc72cc-dd64-4096-97de-6767edf4cd6b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.165229 Jun 30 04:21:05.927487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 326/667] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:05 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:06.018098 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bd26dca0-6da6-439f-abb5-655414d1361e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:06.018803 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-bd26dca0-6da6-439f-abb5-655414d1361e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:06.026631 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bd26dca0-6da6-439f-abb5-655414d1361e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:06.027583 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bd26dca0-6da6-439f-abb5-655414d1361e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:06.028349 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bd26dca0-6da6-439f-abb5-655414d1361e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:06.028778 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bd26dca0-6da6-439f-abb5-655414d1361e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:06.173023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-bd26dca0-6da6-439f-abb5-655414d1361e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:06.181553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-bd26dca0-6da6-439f-abb5-655414d1361e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:06.183973 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-bd26dca0-6da6-439f-abb5-655414d1361e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:06.185621 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bd26dca0-6da6-439f-abb5-655414d1361e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.171869 Jun 30 04:21:06.186188 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 342/668] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:06 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:21:06.202398 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9f0afb8e-9d1b-4d56-ac00-5760e2d22f06 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:06.202894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9f0afb8e-9d1b-4d56-ac00-5760e2d22f06 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:06.209290 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f0afb8e-9d1b-4d56-ac00-5760e2d22f06 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:06.209737 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f0afb8e-9d1b-4d56-ac00-5760e2d22f06 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:06.210490 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f0afb8e-9d1b-4d56-ac00-5760e2d22f06 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:06.210924 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f0afb8e-9d1b-4d56-ac00-5760e2d22f06 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:06.236261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9f0afb8e-9d1b-4d56-ac00-5760e2d22f06 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:21:06.319806 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9f0afb8e-9d1b-4d56-ac00-5760e2d22f06 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 204 len: 0 microversion: 2.1 time: 0.121091 Jun 30 04:21:06.320402 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 327/669] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:21:06 2022] DELETE /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:21:06.329078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9d1f6fc2-7f91-4fb0-858d-7096a28ed94a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:06.329833 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9d1f6fc2-7f91-4fb0-858d-7096a28ed94a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:06.336459 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9d1f6fc2-7f91-4fb0-858d-7096a28ed94a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:06.336943 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9d1f6fc2-7f91-4fb0-858d-7096a28ed94a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:06.337647 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9d1f6fc2-7f91-4fb0-858d-7096a28ed94a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:06.338069 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9d1f6fc2-7f91-4fb0-858d-7096a28ed94a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:06.479975 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9d1f6fc2-7f91-4fb0-858d-7096a28ed94a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:06.487755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9d1f6fc2-7f91-4fb0-858d-7096a28ed94a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1576 microversion: 2.1 time: 0.162934 Jun 30 04:21:06.488337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 343/670] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:06 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:06.944968 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-01d6242d-8c62-41ea-acb1-e5ccafffd7fb tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:06.945711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-01d6242d-8c62-41ea-acb1-e5ccafffd7fb tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:06.952607 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-01d6242d-8c62-41ea-acb1-e5ccafffd7fb tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:06.953046 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-01d6242d-8c62-41ea-acb1-e5ccafffd7fb tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:06.953806 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-01d6242d-8c62-41ea-acb1-e5ccafffd7fb tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:06.954227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-01d6242d-8c62-41ea-acb1-e5ccafffd7fb tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:07.107575 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-01d6242d-8c62-41ea-acb1-e5ccafffd7fb tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:07.116117 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-01d6242d-8c62-41ea-acb1-e5ccafffd7fb tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.175482 Jun 30 04:21:07.116667 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 328/671] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:06 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:07.205877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c5149dae-6a00-482c-9b81-aacb683d38d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:07.206605 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c5149dae-6a00-482c-9b81-aacb683d38d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:07.214825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c5149dae-6a00-482c-9b81-aacb683d38d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:07.215295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c5149dae-6a00-482c-9b81-aacb683d38d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:07.216060 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c5149dae-6a00-482c-9b81-aacb683d38d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:07.216487 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c5149dae-6a00-482c-9b81-aacb683d38d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:07.356488 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c5149dae-6a00-482c-9b81-aacb683d38d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:07.365164 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c5149dae-6a00-482c-9b81-aacb683d38d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:07.367338 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c5149dae-6a00-482c-9b81-aacb683d38d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:07.368500 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c5149dae-6a00-482c-9b81-aacb683d38d6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.166605 Jun 30 04:21:07.369067 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 344/672] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:07 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:07.505151 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-20117e36-cb3c-45bf-a35b-d394a9c34d3c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:07.506033 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-20117e36-cb3c-45bf-a35b-d394a9c34d3c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:07.512878 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-20117e36-cb3c-45bf-a35b-d394a9c34d3c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:07.513324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-20117e36-cb3c-45bf-a35b-d394a9c34d3c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:07.514330 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-20117e36-cb3c-45bf-a35b-d394a9c34d3c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:07.514787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-20117e36-cb3c-45bf-a35b-d394a9c34d3c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:07.661236 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-20117e36-cb3c-45bf-a35b-d394a9c34d3c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:07.668864 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-20117e36-cb3c-45bf-a35b-d394a9c34d3c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1576 microversion: 2.1 time: 0.167684 Jun 30 04:21:07.669430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 329/673] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:07 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:08.140368 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-77bc8139-7582-4c8c-b342-1837dbe25593 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:08.140368 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-77bc8139-7582-4c8c-b342-1837dbe25593 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:08.149161 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-77bc8139-7582-4c8c-b342-1837dbe25593 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:08.150053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-77bc8139-7582-4c8c-b342-1837dbe25593 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:08.151469 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-77bc8139-7582-4c8c-b342-1837dbe25593 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:08.152754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-77bc8139-7582-4c8c-b342-1837dbe25593 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:08.183266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:08.321788 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-77bc8139-7582-4c8c-b342-1837dbe25593 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:08.331606 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-77bc8139-7582-4c8c-b342-1837dbe25593 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.199682 Jun 30 04:21:08.339149 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 345/674] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:08 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:08.385945 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-81fb7be2-1bba-4e95-9b6f-3d96be861498 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:08.386693 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-81fb7be2-1bba-4e95-9b6f-3d96be861498 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:08.394058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81fb7be2-1bba-4e95-9b6f-3d96be861498 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:08.394443 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81fb7be2-1bba-4e95-9b6f-3d96be861498 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:08.395236 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81fb7be2-1bba-4e95-9b6f-3d96be861498 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:08.395664 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81fb7be2-1bba-4e95-9b6f-3d96be861498 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:08.551261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-81fb7be2-1bba-4e95-9b6f-3d96be861498 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:08.560004 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-81fb7be2-1bba-4e95-9b6f-3d96be861498 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:08.561508 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-81fb7be2-1bba-4e95-9b6f-3d96be861498 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:08.562683 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-81fb7be2-1bba-4e95-9b6f-3d96be861498 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.180698 Jun 30 04:21:08.564984 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 330/675] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:08 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:08.685943 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5a47a99b-c19b-4922-aac7-c3ea242f57bd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:08.686524 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5a47a99b-c19b-4922-aac7-c3ea242f57bd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:08.692869 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5a47a99b-c19b-4922-aac7-c3ea242f57bd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:08.693379 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5a47a99b-c19b-4922-aac7-c3ea242f57bd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:08.694396 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5a47a99b-c19b-4922-aac7-c3ea242f57bd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:08.694829 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5a47a99b-c19b-4922-aac7-c3ea242f57bd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:08.847267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5a47a99b-c19b-4922-aac7-c3ea242f57bd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:08.855085 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5a47a99b-c19b-4922-aac7-c3ea242f57bd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1576 microversion: 2.1 time: 0.173171 Jun 30 04:21:08.855654 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 346/676] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:08 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:09.350140 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-111387aa-d29f-4487-85d7-307e3aeff451 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:09.351129 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-111387aa-d29f-4487-85d7-307e3aeff451 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:09.357575 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-111387aa-d29f-4487-85d7-307e3aeff451 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:09.358002 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-111387aa-d29f-4487-85d7-307e3aeff451 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:09.358781 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-111387aa-d29f-4487-85d7-307e3aeff451 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:09.359225 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-111387aa-d29f-4487-85d7-307e3aeff451 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:09.521507 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-111387aa-d29f-4487-85d7-307e3aeff451 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:09.531079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-111387aa-d29f-4487-85d7-307e3aeff451 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.185548 Jun 30 04:21:09.531701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 331/677] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:09 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:09.581911 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-85494825-f882-48f0-8fac-2bbf34aecee6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:09.582623 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-85494825-f882-48f0-8fac-2bbf34aecee6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:09.589695 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-85494825-f882-48f0-8fac-2bbf34aecee6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:09.590142 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-85494825-f882-48f0-8fac-2bbf34aecee6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:09.590908 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-85494825-f882-48f0-8fac-2bbf34aecee6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:09.591372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-85494825-f882-48f0-8fac-2bbf34aecee6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:09.730900 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-85494825-f882-48f0-8fac-2bbf34aecee6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:09.741579 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-85494825-f882-48f0-8fac-2bbf34aecee6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:09.743247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-85494825-f882-48f0-8fac-2bbf34aecee6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:09.744543 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-85494825-f882-48f0-8fac-2bbf34aecee6 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.166689 Jun 30 04:21:09.745193 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 347/678] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:09 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:09.872531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c164352e-f84e-47fc-93d3-55a43b5cbb8f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:09.873089 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c164352e-f84e-47fc-93d3-55a43b5cbb8f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:09.879507 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c164352e-f84e-47fc-93d3-55a43b5cbb8f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:09.879949 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c164352e-f84e-47fc-93d3-55a43b5cbb8f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:09.880735 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c164352e-f84e-47fc-93d3-55a43b5cbb8f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:09.881191 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c164352e-f84e-47fc-93d3-55a43b5cbb8f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:10.024517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c164352e-f84e-47fc-93d3-55a43b5cbb8f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:10.032679 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c164352e-f84e-47fc-93d3-55a43b5cbb8f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1576 microversion: 2.1 time: 0.164270 Jun 30 04:21:10.033267 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 332/679] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:09 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:10.361499 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 04:21:10.362206 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Thu Jun 30 04:21:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 04:21:10.548988 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5704af65-72e4-4c71-850c-7d1cd561d77d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:10.549505 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5704af65-72e4-4c71-850c-7d1cd561d77d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:10.556164 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5704af65-72e4-4c71-850c-7d1cd561d77d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:10.556609 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5704af65-72e4-4c71-850c-7d1cd561d77d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:10.557376 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5704af65-72e4-4c71-850c-7d1cd561d77d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:10.557810 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5704af65-72e4-4c71-850c-7d1cd561d77d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:10.699731 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5704af65-72e4-4c71-850c-7d1cd561d77d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:10.707432 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5704af65-72e4-4c71-850c-7d1cd561d77d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.162446 Jun 30 04:21:10.708105 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 348/680] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:10 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:10.762876 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1e05350c-c1de-41f9-8223-21d893275838 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:10.763660 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1e05350c-c1de-41f9-8223-21d893275838 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:10.770780 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1e05350c-c1de-41f9-8223-21d893275838 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:10.771237 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1e05350c-c1de-41f9-8223-21d893275838 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:10.772290 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1e05350c-c1de-41f9-8223-21d893275838 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:10.772748 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1e05350c-c1de-41f9-8223-21d893275838 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:10.914975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1e05350c-c1de-41f9-8223-21d893275838 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:10.922280 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1e05350c-c1de-41f9-8223-21d893275838 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:10.923861 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1e05350c-c1de-41f9-8223-21d893275838 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:10.925033 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1e05350c-c1de-41f9-8223-21d893275838 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.166183 Jun 30 04:21:10.925590 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 333/681] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:10 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:11.050227 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e9af39e7-c9e9-4c54-880e-527b100fe0e2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:11.051411 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e9af39e7-c9e9-4c54-880e-527b100fe0e2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:11.058771 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e9af39e7-c9e9-4c54-880e-527b100fe0e2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:11.059211 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e9af39e7-c9e9-4c54-880e-527b100fe0e2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:11.060015 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e9af39e7-c9e9-4c54-880e-527b100fe0e2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:11.060424 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e9af39e7-c9e9-4c54-880e-527b100fe0e2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:11.205875 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e9af39e7-c9e9-4c54-880e-527b100fe0e2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:11.213966 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e9af39e7-c9e9-4c54-880e-527b100fe0e2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1576 microversion: 2.1 time: 0.167837 Jun 30 04:21:11.214562 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 349/682] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:11 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:11.725719 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d61a3c7f-1183-401d-be54-e9adf8085b5c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:11.726310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d61a3c7f-1183-401d-be54-e9adf8085b5c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:11.733529 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d61a3c7f-1183-401d-be54-e9adf8085b5c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:11.734212 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d61a3c7f-1183-401d-be54-e9adf8085b5c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:11.735114 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d61a3c7f-1183-401d-be54-e9adf8085b5c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:11.735502 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d61a3c7f-1183-401d-be54-e9adf8085b5c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:11.890128 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d61a3c7f-1183-401d-be54-e9adf8085b5c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:11.899861 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d61a3c7f-1183-401d-be54-e9adf8085b5c tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.178665 Jun 30 04:21:11.900442 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 334/683] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:11 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:11.944567 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c433ac50-b621-4c77-b51f-f3d6316d8cb1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:11.945316 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c433ac50-b621-4c77-b51f-f3d6316d8cb1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:11.952138 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c433ac50-b621-4c77-b51f-f3d6316d8cb1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:11.952577 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c433ac50-b621-4c77-b51f-f3d6316d8cb1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:11.953345 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c433ac50-b621-4c77-b51f-f3d6316d8cb1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:11.953772 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c433ac50-b621-4c77-b51f-f3d6316d8cb1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:12.097362 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c433ac50-b621-4c77-b51f-f3d6316d8cb1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:12.107570 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c433ac50-b621-4c77-b51f-f3d6316d8cb1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:12.110644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c433ac50-b621-4c77-b51f-f3d6316d8cb1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:12.110903 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c433ac50-b621-4c77-b51f-f3d6316d8cb1 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.170961 Jun 30 04:21:12.122288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 350/684] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:11 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:12.231630 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-61e3619f-b7f9-4ebe-8e04-d15cb3e8a5ac tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:12.232243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-61e3619f-b7f9-4ebe-8e04-d15cb3e8a5ac tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:12.239509 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e3619f-b7f9-4ebe-8e04-d15cb3e8a5ac tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:12.240528 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e3619f-b7f9-4ebe-8e04-d15cb3e8a5ac tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:12.241490 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e3619f-b7f9-4ebe-8e04-d15cb3e8a5ac tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:12.241959 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e3619f-b7f9-4ebe-8e04-d15cb3e8a5ac tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:12.395016 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-61e3619f-b7f9-4ebe-8e04-d15cb3e8a5ac tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:12.403304 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-61e3619f-b7f9-4ebe-8e04-d15cb3e8a5ac tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1576 microversion: 2.1 time: 0.176056 Jun 30 04:21:12.403978 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 335/685] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:12 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:12.918498 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f2da5e88-07bc-429e-bb75-14ea61a12cc9 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:12.919189 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f2da5e88-07bc-429e-bb75-14ea61a12cc9 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:12.925840 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f2da5e88-07bc-429e-bb75-14ea61a12cc9 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:12.926283 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f2da5e88-07bc-429e-bb75-14ea61a12cc9 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:12.927059 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f2da5e88-07bc-429e-bb75-14ea61a12cc9 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:12.927653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f2da5e88-07bc-429e-bb75-14ea61a12cc9 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:13.066049 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f2da5e88-07bc-429e-bb75-14ea61a12cc9 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:13.074092 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f2da5e88-07bc-429e-bb75-14ea61a12cc9 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.159832 Jun 30 04:21:13.074655 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 351/686] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:12 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:13.130828 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5138124f-d513-48f0-ba71-ef7ba2d5bf78 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:13.131607 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5138124f-d513-48f0-ba71-ef7ba2d5bf78 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:13.138709 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5138124f-d513-48f0-ba71-ef7ba2d5bf78 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:13.139211 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5138124f-d513-48f0-ba71-ef7ba2d5bf78 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:13.139977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5138124f-d513-48f0-ba71-ef7ba2d5bf78 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:13.140406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5138124f-d513-48f0-ba71-ef7ba2d5bf78 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:13.279129 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5138124f-d513-48f0-ba71-ef7ba2d5bf78 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:13.288078 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5138124f-d513-48f0-ba71-ef7ba2d5bf78 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:13.289566 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5138124f-d513-48f0-ba71-ef7ba2d5bf78 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:13.290713 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5138124f-d513-48f0-ba71-ef7ba2d5bf78 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.164402 Jun 30 04:21:13.291273 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 336/687] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:13 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:13.421220 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ca67c934-b6bb-4aed-bf29-b2565d1e95dd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:13.421859 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ca67c934-b6bb-4aed-bf29-b2565d1e95dd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:13.429506 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca67c934-b6bb-4aed-bf29-b2565d1e95dd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:13.429973 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca67c934-b6bb-4aed-bf29-b2565d1e95dd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:13.430755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca67c934-b6bb-4aed-bf29-b2565d1e95dd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:13.431234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ca67c934-b6bb-4aed-bf29-b2565d1e95dd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:13.496355 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b6fe1ae1-8d2e-435c-bbf2-70c5dc596b3e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1358399468"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:13.497039 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b6fe1ae1-8d2e-435c-bbf2-70c5dc596b3e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:13.503596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b6fe1ae1-8d2e-435c-bbf2-70c5dc596b3e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:13.504041 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b6fe1ae1-8d2e-435c-bbf2-70c5dc596b3e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:13.504800 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b6fe1ae1-8d2e-435c-bbf2-70c5dc596b3e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:13.505562 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b6fe1ae1-8d2e-435c-bbf2-70c5dc596b3e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:13.615138 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ca67c934-b6bb-4aed-bf29-b2565d1e95dd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:13.623009 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ca67c934-b6bb-4aed-bf29-b2565d1e95dd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1576 microversion: 2.1 time: 0.205893 Jun 30 04:21:13.623623 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 352/688] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:13 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:13.673671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.network.security_group_api [None req-b6fe1ae1-8d2e-435c-bbf2-70c5dc596b3e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Removing security group 9d0d7e41-0de4-435b-8be5-77663521a9cc from port 9bba023e-b365-43ab-a64b-b1010d222f8a Jun 30 04:21:14.053191 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b6fe1ae1-8d2e-435c-bbf2-70c5dc596b3e tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "POST /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/action" status: 202 len: 0 microversion: 2.1 time: 0.560603 Jun 30 04:21:14.055462 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 337/689] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:21:13 2022] POST /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:21:14.062888 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-0be12e92-5a1f-46c9-972a-6b337ff300c0 req-58519527-420d-4b9f-a3cf-1a96f364a75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51520645-cd99-466c-83b2-8f735e7d04cf", "tag": "9bba023e-b365-43ab-a64b-b1010d222f8a"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:14.072278 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-0be12e92-5a1f-46c9-972a-6b337ff300c0 req-58519527-420d-4b9f-a3cf-1a96f364a75e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:14.073908 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-0be12e92-5a1f-46c9-972a-6b337ff300c0 req-58519527-420d-4b9f-a3cf-1a96f364a75e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:14.093494 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-37f9fb45-c876-47bb-9d8e-4089f28d028f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:14.094021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-37f9fb45-c876-47bb-9d8e-4089f28d028f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:14.099803 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-0be12e92-5a1f-46c9-972a-6b337ff300c0 req-58519527-420d-4b9f-a3cf-1a96f364a75e service nova] Creating event network-changed:9bba023e-b365-43ab-a64b-b1010d222f8a for instance 51520645-cd99-466c-83b2-8f735e7d04cf on hv-cinder-84684 Jun 30 04:21:14.102746 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37f9fb45-c876-47bb-9d8e-4089f28d028f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:14.103213 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37f9fb45-c876-47bb-9d8e-4089f28d028f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:14.103987 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37f9fb45-c876-47bb-9d8e-4089f28d028f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:14.104680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37f9fb45-c876-47bb-9d8e-4089f28d028f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:14.116273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-0be12e92-5a1f-46c9-972a-6b337ff300c0 req-58519527-420d-4b9f-a3cf-1a96f364a75e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057400 Jun 30 04:21:14.123639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 353/690] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:14.292355 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-37f9fb45-c876-47bb-9d8e-4089f28d028f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:14.301312 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-37f9fb45-c876-47bb-9d8e-4089f28d028f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.213389 Jun 30 04:21:14.301916 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 338/691] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:14 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:14.325293 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8f502235-2f45-43f1-8f0c-9fc291848ec0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:14.326450 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8f502235-2f45-43f1-8f0c-9fc291848ec0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:14.334613 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f502235-2f45-43f1-8f0c-9fc291848ec0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:14.335062 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f502235-2f45-43f1-8f0c-9fc291848ec0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:14.335894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f502235-2f45-43f1-8f0c-9fc291848ec0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:14.336580 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f502235-2f45-43f1-8f0c-9fc291848ec0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:14.487214 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8f502235-2f45-43f1-8f0c-9fc291848ec0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:14.495676 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8f502235-2f45-43f1-8f0c-9fc291848ec0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:14.497921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8f502235-2f45-43f1-8f0c-9fc291848ec0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:14.499132 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8f502235-2f45-43f1-8f0c-9fc291848ec0 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.183109 Jun 30 04:21:14.499717 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 354/692] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:14 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:14.640437 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ece51a65-bd6e-40cb-bf68-8034331a9745 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:14.640956 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ece51a65-bd6e-40cb-bf68-8034331a9745 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:14.642897 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:14.648975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ece51a65-bd6e-40cb-bf68-8034331a9745 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:14.649403 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ece51a65-bd6e-40cb-bf68-8034331a9745 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:14.650177 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ece51a65-bd6e-40cb-bf68-8034331a9745 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:14.650603 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ece51a65-bd6e-40cb-bf68-8034331a9745 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:14.786499 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ece51a65-bd6e-40cb-bf68-8034331a9745 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:14.788956 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:14.796216 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ece51a65-bd6e-40cb-bf68-8034331a9745 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1576 microversion: 2.1 time: 0.159765 Jun 30 04:21:14.796943 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 339/693] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:14 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:15.206418 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-06644050-2973-4610-848f-10897606c8aa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:15.206959 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-06644050-2973-4610-848f-10897606c8aa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:15.214402 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06644050-2973-4610-848f-10897606c8aa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.214855 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06644050-2973-4610-848f-10897606c8aa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.215751 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06644050-2973-4610-848f-10897606c8aa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.216224 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06644050-2973-4610-848f-10897606c8aa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.278120 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-d33e1344-a7ef-4d31-a9d4-3ca1b222d771 req-3eebbffb-d743-4e7a-ad9f-2a6c145d1bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51520645-cd99-466c-83b2-8f735e7d04cf", "tag": "9bba023e-b365-43ab-a64b-b1010d222f8a"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:15.290215 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-d33e1344-a7ef-4d31-a9d4-3ca1b222d771 req-3eebbffb-d743-4e7a-ad9f-2a6c145d1bd4 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.290855 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-d33e1344-a7ef-4d31-a9d4-3ca1b222d771 req-3eebbffb-d743-4e7a-ad9f-2a6c145d1bd4 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.297519 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-06644050-2973-4610-848f-10897606c8aa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lazy-loading 'services' on Instance uuid 51520645-cd99-466c-83b2-8f735e7d04cf {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:21:15.304108 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-d33e1344-a7ef-4d31-a9d4-3ca1b222d771 req-3eebbffb-d743-4e7a-ad9f-2a6c145d1bd4 service nova] Creating event network-changed:9bba023e-b365-43ab-a64b-b1010d222f8a for instance 51520645-cd99-466c-83b2-8f735e7d04cf on hv-cinder-84684 Jun 30 04:21:15.309401 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-d33e1344-a7ef-4d31-a9d4-3ca1b222d771 req-3eebbffb-d743-4e7a-ad9f-2a6c145d1bd4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104370 Jun 30 04:21:15.309990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 340/694] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:21:15.319750 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fa4e4775-5b0f-499b-ae6e-10056a7fdbb3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:15.320443 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fa4e4775-5b0f-499b-ae6e-10056a7fdbb3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:15.327625 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa4e4775-5b0f-499b-ae6e-10056a7fdbb3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.328061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa4e4775-5b0f-499b-ae6e-10056a7fdbb3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.329016 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa4e4775-5b0f-499b-ae6e-10056a7fdbb3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.329597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa4e4775-5b0f-499b-ae6e-10056a7fdbb3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.382662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-06644050-2973-4610-848f-10897606c8aa tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments/aa3299ad-db0c-48d3-baff-6cd0e5d0c95c" status: 202 len: 0 microversion: 2.1 time: 0.180117 Jun 30 04:21:15.383577 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 355/695] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:21:15 2022] DELETE /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments/aa3299ad-db0c-48d3-baff-6cd0e5d0c95c => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:21:15.392345 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bf039bb1-2156-4be0-b1ee-90fa45daf4c0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:15.393404 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-bf039bb1-2156-4be0-b1ee-90fa45daf4c0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:15.400263 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bf039bb1-2156-4be0-b1ee-90fa45daf4c0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.401166 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bf039bb1-2156-4be0-b1ee-90fa45daf4c0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.401477 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bf039bb1-2156-4be0-b1ee-90fa45daf4c0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.402266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bf039bb1-2156-4be0-b1ee-90fa45daf4c0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.433576 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bf039bb1-2156-4be0-b1ee-90fa45daf4c0 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045300 Jun 30 04:21:15.434460 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 356/696] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:21:15 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:15.470429 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fa4e4775-5b0f-499b-ae6e-10056a7fdbb3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:15.478334 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fa4e4775-5b0f-499b-ae6e-10056a7fdbb3 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.162938 Jun 30 04:21:15.478915 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 341/697] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:15 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:15.517482 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-07507258-7c61-4e64-8c30-eae87c8d738e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:15.518004 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-07507258-7c61-4e64-8c30-eae87c8d738e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:15.524714 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-07507258-7c61-4e64-8c30-eae87c8d738e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.525167 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-07507258-7c61-4e64-8c30-eae87c8d738e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.525983 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-07507258-7c61-4e64-8c30-eae87c8d738e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.526420 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-07507258-7c61-4e64-8c30-eae87c8d738e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.664736 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-07507258-7c61-4e64-8c30-eae87c8d738e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:15.673165 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-07507258-7c61-4e64-8c30-eae87c8d738e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:15.674722 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-07507258-7c61-4e64-8c30-eae87c8d738e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:15.675909 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-07507258-7c61-4e64-8c30-eae87c8d738e tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.162582 Jun 30 04:21:15.676516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 357/698] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:15 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:15.813289 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-33c66ca3-62d8-4f2b-9669-0f1ee2a0183f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:15.813797 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-33c66ca3-62d8-4f2b-9669-0f1ee2a0183f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:15.820639 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-33c66ca3-62d8-4f2b-9669-0f1ee2a0183f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.821080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-33c66ca3-62d8-4f2b-9669-0f1ee2a0183f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.821830 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-33c66ca3-62d8-4f2b-9669-0f1ee2a0183f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:15.822252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-33c66ca3-62d8-4f2b-9669-0f1ee2a0183f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:15.961222 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-33c66ca3-62d8-4f2b-9669-0f1ee2a0183f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:15.969109 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-33c66ca3-62d8-4f2b-9669-0f1ee2a0183f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1576 microversion: 2.1 time: 0.159742 Jun 30 04:21:15.969613 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 342/699] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:15 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:16.446851 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-943aa1d6-0815-4874-98ea-4c97d1ab81c1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:16.447731 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-943aa1d6-0815-4874-98ea-4c97d1ab81c1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:16.454796 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-943aa1d6-0815-4874-98ea-4c97d1ab81c1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:16.455277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-943aa1d6-0815-4874-98ea-4c97d1ab81c1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:16.456045 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-943aa1d6-0815-4874-98ea-4c97d1ab81c1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:16.456490 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-943aa1d6-0815-4874-98ea-4c97d1ab81c1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:16.487610 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-943aa1d6-0815-4874-98ea-4c97d1ab81c1 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Jun 30 04:21:16.488181 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 358/700] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:21:16 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:16.498592 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e15daa35-aec4-4e04-b929-792da0c7800d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:16.499216 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e15daa35-aec4-4e04-b929-792da0c7800d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:16.506721 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e15daa35-aec4-4e04-b929-792da0c7800d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:16.507171 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e15daa35-aec4-4e04-b929-792da0c7800d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:16.507976 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e15daa35-aec4-4e04-b929-792da0c7800d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:16.508403 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e15daa35-aec4-4e04-b929-792da0c7800d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:16.694733 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7c83713d-8b71-42ed-bd14-0c0069af18be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:16.695504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7c83713d-8b71-42ed-bd14-0c0069af18be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:16.702381 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7c83713d-8b71-42ed-bd14-0c0069af18be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:16.702727 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7c83713d-8b71-42ed-bd14-0c0069af18be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:16.703703 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7c83713d-8b71-42ed-bd14-0c0069af18be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:16.704144 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7c83713d-8b71-42ed-bd14-0c0069af18be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:17.295459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e15daa35-aec4-4e04-b929-792da0c7800d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:17.304709 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e15daa35-aec4-4e04-b929-792da0c7800d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.809890 Jun 30 04:21:17.305442 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 343/701] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:16 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:17.313444 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-598105a2-7de9-41d1-bc93-9031ca9c8ea3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:17.314324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-598105a2-7de9-41d1-bc93-9031ca9c8ea3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:17.320981 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-598105a2-7de9-41d1-bc93-9031ca9c8ea3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:17.321701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-598105a2-7de9-41d1-bc93-9031ca9c8ea3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:17.322524 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-598105a2-7de9-41d1-bc93-9031ca9c8ea3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:17.323022 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-598105a2-7de9-41d1-bc93-9031ca9c8ea3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:17.475444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7c83713d-8b71-42ed-bd14-0c0069af18be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:17.483866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7c83713d-8b71-42ed-bd14-0c0069af18be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:17.485367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7c83713d-8b71-42ed-bd14-0c0069af18be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:17.486537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7c83713d-8b71-42ed-bd14-0c0069af18be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.796283 Jun 30 04:21:17.487132 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 359/702] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:16 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:21:17.501471 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-20537c38-57e5-4c97-9c5e-bc9c7fc66a76 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:17.502324 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-20537c38-57e5-4c97-9c5e-bc9c7fc66a76 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:17.509113 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-20537c38-57e5-4c97-9c5e-bc9c7fc66a76 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:17.509562 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-20537c38-57e5-4c97-9c5e-bc9c7fc66a76 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:17.510330 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-20537c38-57e5-4c97-9c5e-bc9c7fc66a76 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:17.510763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-20537c38-57e5-4c97-9c5e-bc9c7fc66a76 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:17.542308 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-20537c38-57e5-4c97-9c5e-bc9c7fc66a76 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046268 Jun 30 04:21:17.542871 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 360/703] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:21:17 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 04:21:17.553736 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a9523070-bcf3-4cf1-acf6-a6fc8225a402 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:17.554299 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a9523070-bcf3-4cf1-acf6-a6fc8225a402 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:17.560613 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9523070-bcf3-4cf1-acf6-a6fc8225a402 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:17.561312 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9523070-bcf3-4cf1-acf6-a6fc8225a402 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:17.562078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9523070-bcf3-4cf1-acf6-a6fc8225a402 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:17.562504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a9523070-bcf3-4cf1-acf6-a6fc8225a402 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:17.661579 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:17.664592 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-a9523070-bcf3-4cf1-acf6-a6fc8225a402 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] HTTP exception thrown: Instance 51520645-cd99-466c-83b2-8f735e7d04cf is not attached to volume aa3299ad-db0c-48d3-baff-6cd0e5d0c95c Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a9523070-bcf3-4cf1-acf6-a6fc8225a402 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Request method failure captured: Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: DELETE /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments/aa3299ad-db0c-48d3-baff-6cd0e5d0c95c HTTP/1.1 Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSQReKfUbBC7U2lgc8ZUO32BawTbtwf9oUGo43Vm7okOTpO_iMn-Anf4YNFOS_Ce7O-bjMl2J39jhh-JU46aWbdT1MAfMRqCQOalbYvtGeZNanHoKFWBX7ZfAaBsmxC1gg4RaFnP9bIDpu8mvURgnIAIEfPa0Gmso5e7O5JR2OvXXSc Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: bf207393082c48d09f827e16d99b2609 Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-TestMinimumBasicScenario-130177793 Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:21:17.678530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bf207393082c48d09f827e16d99b2609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bf207393082c48d09f827e16d99b2609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bf207393082c48d09f827e16d99b2609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bf207393082c48d09f827e16d99b2609"}]}] Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-TestMinimumBasicScenario-130177793 Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: bf207393082c48d09f827e16d99b2609 Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-TestMinimumBasicScenario-130177793 Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-TestMinimumBasicScenario-130177793-project Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: 17540f6ae3234debb5cfe7580f78d61d Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-TestMinimumBasicScenario-130177793-project Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:21:17.680178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 51520645-cd99-466c-83b2-8f735e7d04cf is not attached to volume aa3299ad-db0c-48d3-baff-6cd0e5d0c95c Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'server_id': '51520645-cd99-466c-83b2-8f735e7d04cf', 'id': 'aa3299ad-db0c-48d3-baff-6cd0e5d0c95c'} Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id aa3299ad-db0c-48d3-baff-6cd0e5d0c95c. Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:21:17.681031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51520645-cd99-466c-83b2-8f735e7d04cf is not attached to volume aa3299ad-db0c-48d3-baff-6cd0e5d0c95c Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51520645-cd99-466c-83b2-8f735e7d04cf is not attached to volume aa3299ad-db0c-48d3-baff-6cd0e5d0c95c Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:17.683242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a9523070-bcf3-4cf1-acf6-a6fc8225a402 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Returning 404 to user: Instance 51520645-cd99-466c-83b2-8f735e7d04cf is not attached to volume aa3299ad-db0c-48d3-baff-6cd0e5d0c95c {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:21:17.684352 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a9523070-bcf3-4cf1-acf6-a6fc8225a402 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments/aa3299ad-db0c-48d3-baff-6cd0e5d0c95c" status: 404 len: 154 microversion: 2.1 time: 0.130724 Jun 30 04:21:17.684352 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 361/704] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:21:17 2022] DELETE /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf/os-volume_attachments/aa3299ad-db0c-48d3-baff-6cd0e5d0c95c => generated 154 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 04:21:17.794774 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-598105a2-7de9-41d1-bc93-9031ca9c8ea3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:17.802676 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-598105a2-7de9-41d1-bc93-9031ca9c8ea3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1576 microversion: 2.1 time: 0.495953 Jun 30 04:21:17.803402 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 344/705] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:17 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1576 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:18.322211 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ff834bff-254e-4274-9b9a-dae45db934e0 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:18.322818 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ff834bff-254e-4274-9b9a-dae45db934e0 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:18.325052 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=64 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:18.331688 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff834bff-254e-4274-9b9a-dae45db934e0 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.332145 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff834bff-254e-4274-9b9a-dae45db934e0 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:18.332904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff834bff-254e-4274-9b9a-dae45db934e0 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.333328 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff834bff-254e-4274-9b9a-dae45db934e0 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:18.505929 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b73c5d45-8ba1-4fdb-9cbd-be0f85c81b6d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:18.506766 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b73c5d45-8ba1-4fdb-9cbd-be0f85c81b6d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:18.515285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b73c5d45-8ba1-4fdb-9cbd-be0f85c81b6d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.515666 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b73c5d45-8ba1-4fdb-9cbd-be0f85c81b6d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:18.516443 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b73c5d45-8ba1-4fdb-9cbd-be0f85c81b6d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.516875 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b73c5d45-8ba1-4fdb-9cbd-be0f85c81b6d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:18.582481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ff834bff-254e-4274-9b9a-dae45db934e0 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:18.592294 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ff834bff-254e-4274-9b9a-dae45db934e0 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.274111 Jun 30 04:21:18.593068 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 362/706] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:18 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:18.643537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-6973d6c3-f906-404b-8f87-2bbeae2de936 req-1155d473-c0e8-415f-98c9-d6eee506844f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a0dbf7-3345-49a9-9785-a36af6da4a5f", "name": "network-vif-deleted", "tag": "a24525d3-4d16-4d0a-a3e9-14e74a52e46d"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:18.656329 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-6973d6c3-f906-404b-8f87-2bbeae2de936 req-1155d473-c0e8-415f-98c9-d6eee506844f service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.662260 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-6973d6c3-f906-404b-8f87-2bbeae2de936 req-1155d473-c0e8-415f-98c9-d6eee506844f service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:18.678161 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-6973d6c3-f906-404b-8f87-2bbeae2de936 req-1155d473-c0e8-415f-98c9-d6eee506844f service nova] Creating event network-vif-deleted:a24525d3-4d16-4d0a-a3e9-14e74a52e46d for instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f on hv-cinder-84684 Jun 30 04:21:18.684031 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-6973d6c3-f906-404b-8f87-2bbeae2de936 req-1155d473-c0e8-415f-98c9-d6eee506844f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048216 Jun 30 04:21:18.684980 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 363/707] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:18.713986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b73c5d45-8ba1-4fdb-9cbd-be0f85c81b6d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:18.722720 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b73c5d45-8ba1-4fdb-9cbd-be0f85c81b6d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:18.724476 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b73c5d45-8ba1-4fdb-9cbd-be0f85c81b6d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:18.726157 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b73c5d45-8ba1-4fdb-9cbd-be0f85c81b6d tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.224603 Jun 30 04:21:18.726949 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 345/708] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:18 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:18.821102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-965a50bf-2137-4143-b0a2-5625969c82e8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:18.822041 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-965a50bf-2137-4143-b0a2-5625969c82e8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:18.823081 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d5d01fce-6210-477e-af98-38edfea1e8b6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:18.823599 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d5d01fce-6210-477e-af98-38edfea1e8b6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:18.828638 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-965a50bf-2137-4143-b0a2-5625969c82e8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.829078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-965a50bf-2137-4143-b0a2-5625969c82e8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:18.829844 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-965a50bf-2137-4143-b0a2-5625969c82e8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.830273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-965a50bf-2137-4143-b0a2-5625969c82e8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:18.830584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d5d01fce-6210-477e-af98-38edfea1e8b6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.831127 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d5d01fce-6210-477e-af98-38edfea1e8b6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:18.832176 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d5d01fce-6210-477e-af98-38edfea1e8b6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.832851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d5d01fce-6210-477e-af98-38edfea1e8b6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:18.861465 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d5d01fce-6210-477e-af98-38edfea1e8b6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:21:18.893462 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-965a50bf-2137-4143-b0a2-5625969c82e8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:18.903883 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-965a50bf-2137-4143-b0a2-5625969c82e8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1509 microversion: 2.1 time: 0.087550 Jun 30 04:21:18.904472 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 364/709] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:18 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1509 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:18.942688 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d5d01fce-6210-477e-af98-38edfea1e8b6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 204 len: 0 microversion: 2.1 time: 0.123710 Jun 30 04:21:18.943475 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 346/710] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:21:18 2022] DELETE /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 04:21:18.951597 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e54af410-07c5-41f4-8996-794671bcbac4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:18.952206 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e54af410-07c5-41f4-8996-794671bcbac4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:18.958358 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e54af410-07c5-41f4-8996-794671bcbac4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.958978 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e54af410-07c5-41f4-8996-794671bcbac4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:18.960072 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e54af410-07c5-41f4-8996-794671bcbac4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:18.960724 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e54af410-07c5-41f4-8996-794671bcbac4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:19.099740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e54af410-07c5-41f4-8996-794671bcbac4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:19.109579 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e54af410-07c5-41f4-8996-794671bcbac4 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1554 microversion: 2.1 time: 0.161634 Jun 30 04:21:19.119808 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 365/711] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:18 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:19.176980 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-c1bbbdd9-cb60-4db8-a625-856a26c63d1b req-2ecce5b2-73cf-4937-b425-9e2bff5b5b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a344d61b-2dbc-49a8-b5c1-4d5619af3e77", "name": "network-vif-plugged", "status": "completed", "tag": "14e3c353-ee55-4eee-8bdc-9d20ccd23a9e"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:19.186121 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-c1bbbdd9-cb60-4db8-a625-856a26c63d1b req-2ecce5b2-73cf-4937-b425-9e2bff5b5b50 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:19.187033 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-c1bbbdd9-cb60-4db8-a625-856a26c63d1b req-2ecce5b2-73cf-4937-b425-9e2bff5b5b50 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:19.202039 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-c1bbbdd9-cb60-4db8-a625-856a26c63d1b req-2ecce5b2-73cf-4937-b425-9e2bff5b5b50 service nova] Creating event network-vif-plugged:14e3c353-ee55-4eee-8bdc-9d20ccd23a9e for instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 on hv-cinder-84684 Jun 30 04:21:19.207368 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-c1bbbdd9-cb60-4db8-a625-856a26c63d1b req-2ecce5b2-73cf-4937-b425-9e2bff5b5b50 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034442 Jun 30 04:21:19.208685 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 347/712] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:19.610042 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0bce0397-c63c-45e5-aecf-49ab1357ec14 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:19.610615 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0bce0397-c63c-45e5-aecf-49ab1357ec14 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:19.618403 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0bce0397-c63c-45e5-aecf-49ab1357ec14 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:19.618842 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0bce0397-c63c-45e5-aecf-49ab1357ec14 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:19.619630 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0bce0397-c63c-45e5-aecf-49ab1357ec14 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:19.620107 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0bce0397-c63c-45e5-aecf-49ab1357ec14 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:19.745675 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bdc2b91a-2523-464e-986b-97b173f7a37b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:19.746450 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bdc2b91a-2523-464e-986b-97b173f7a37b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:19.753247 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bdc2b91a-2523-464e-986b-97b173f7a37b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:19.753417 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bdc2b91a-2523-464e-986b-97b173f7a37b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:19.754226 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bdc2b91a-2523-464e-986b-97b173f7a37b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:19.754763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bdc2b91a-2523-464e-986b-97b173f7a37b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:19.761185 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0bce0397-c63c-45e5-aecf-49ab1357ec14 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:19.769018 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0bce0397-c63c-45e5-aecf-49ab1357ec14 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.162930 Jun 30 04:21:19.769599 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 366/713] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:19 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:19.902647 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bdc2b91a-2523-464e-986b-97b173f7a37b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:19.914681 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bdc2b91a-2523-464e-986b-97b173f7a37b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:19.916245 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bdc2b91a-2523-464e-986b-97b173f7a37b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:19.917391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bdc2b91a-2523-464e-986b-97b173f7a37b tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.176861 Jun 30 04:21:19.918091 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 348/714] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:19 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:21:19.921168 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-14c34481-9064-46c9-bf99-928010a064a0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:19.921781 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-14c34481-9064-46c9-bf99-928010a064a0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:19.928414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-14c34481-9064-46c9-bf99-928010a064a0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:19.928865 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-14c34481-9064-46c9-bf99-928010a064a0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:19.929627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-14c34481-9064-46c9-bf99-928010a064a0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:19.930061 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-14c34481-9064-46c9-bf99-928010a064a0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:20.004537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-14c34481-9064-46c9-bf99-928010a064a0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:20.013015 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-14c34481-9064-46c9-bf99-928010a064a0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1224 microversion: 2.1 time: 0.095798 Jun 30 04:21:20.013593 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 367/715] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:19 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:20.130969 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-69763f39-2b84-4545-825a-5e5eb075c065 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:20.131673 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-69763f39-2b84-4545-825a-5e5eb075c065 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:20.138894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69763f39-2b84-4545-825a-5e5eb075c065 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:20.139418 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69763f39-2b84-4545-825a-5e5eb075c065 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:20.140265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69763f39-2b84-4545-825a-5e5eb075c065 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:20.140745 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69763f39-2b84-4545-825a-5e5eb075c065 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:20.278552 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-69763f39-2b84-4545-825a-5e5eb075c065 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:20.286190 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-69763f39-2b84-4545-825a-5e5eb075c065 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1554 microversion: 2.1 time: 0.161743 Jun 30 04:21:20.286759 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 349/716] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:20 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:20.789549 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-79d66255-4215-41de-acae-c93414360952 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:20.790156 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-79d66255-4215-41de-acae-c93414360952 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:20.798117 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-79d66255-4215-41de-acae-c93414360952 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:20.798553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-79d66255-4215-41de-acae-c93414360952 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:20.799360 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-79d66255-4215-41de-acae-c93414360952 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:20.799792 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-79d66255-4215-41de-acae-c93414360952 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:20.935917 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-52d16db1-8155-43ae-ad66-3908615240ef tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:20.936635 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-52d16db1-8155-43ae-ad66-3908615240ef tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:20.943572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52d16db1-8155-43ae-ad66-3908615240ef tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:20.944285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52d16db1-8155-43ae-ad66-3908615240ef tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:20.945299 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-79d66255-4215-41de-acae-c93414360952 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:20.945456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52d16db1-8155-43ae-ad66-3908615240ef tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:20.945456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52d16db1-8155-43ae-ad66-3908615240ef tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:20.957150 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-79d66255-4215-41de-acae-c93414360952 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.173192 Jun 30 04:21:20.957831 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 368/717] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:20 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:21.033563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-74bef06c-c93a-4aa3-b4d6-9110526f59f8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:21.034424 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-74bef06c-c93a-4aa3-b4d6-9110526f59f8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:21.045262 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-74bef06c-c93a-4aa3-b4d6-9110526f59f8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:21.046054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-74bef06c-c93a-4aa3-b4d6-9110526f59f8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:21.047348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-74bef06c-c93a-4aa3-b4d6-9110526f59f8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:21.047983 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-74bef06c-c93a-4aa3-b4d6-9110526f59f8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:21.137612 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-74bef06c-c93a-4aa3-b4d6-9110526f59f8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:21.145210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-74bef06c-c93a-4aa3-b4d6-9110526f59f8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1224 microversion: 2.1 time: 0.116811 Jun 30 04:21:21.145782 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 369/718] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:21 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:21.154117 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-52d16db1-8155-43ae-ad66-3908615240ef tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:21.162000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-52d16db1-8155-43ae-ad66-3908615240ef tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:21.163521 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-52d16db1-8155-43ae-ad66-3908615240ef tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:21.164706 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-52d16db1-8155-43ae-ad66-3908615240ef tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.232757 Jun 30 04:21:21.165268 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 350/719] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:20 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:21.304268 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-2f48cf6f-4686-45d3-a444-64d47ebf51cb tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:21.304950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-2f48cf6f-4686-45d3-a444-64d47ebf51cb tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:21.314035 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2f48cf6f-4686-45d3-a444-64d47ebf51cb tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:21.314573 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2f48cf6f-4686-45d3-a444-64d47ebf51cb tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:21.315488 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2f48cf6f-4686-45d3-a444-64d47ebf51cb tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:21.315960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2f48cf6f-4686-45d3-a444-64d47ebf51cb tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:21.536085 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-2f48cf6f-4686-45d3-a444-64d47ebf51cb tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:21.544334 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-2f48cf6f-4686-45d3-a444-64d47ebf51cb tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1554 microversion: 2.1 time: 0.244158 Jun 30 04:21:21.544919 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 370/720] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:21 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:21.826554 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-4941c406-a372-402d-a14c-600c524104ac req-81c1fd7a-034f-486c-93c6-e001a6079404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51520645-cd99-466c-83b2-8f735e7d04cf", "name": "network-vif-deleted", "tag": "9bba023e-b365-43ab-a64b-b1010d222f8a"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:21.838193 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4941c406-a372-402d-a14c-600c524104ac req-81c1fd7a-034f-486c-93c6-e001a6079404 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:21.838831 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4941c406-a372-402d-a14c-600c524104ac req-81c1fd7a-034f-486c-93c6-e001a6079404 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:21.853157 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-4941c406-a372-402d-a14c-600c524104ac req-81c1fd7a-034f-486c-93c6-e001a6079404 service nova] Creating event network-vif-deleted:9bba023e-b365-43ab-a64b-b1010d222f8a for instance 51520645-cd99-466c-83b2-8f735e7d04cf on hv-cinder-84684 Jun 30 04:21:21.858056 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-4941c406-a372-402d-a14c-600c524104ac req-81c1fd7a-034f-486c-93c6-e001a6079404 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037001 Jun 30 04:21:21.858632 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 351/721] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:21.978115 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fb6522b9-ab3e-411e-afb9-a7fa89baa012 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:21.978707 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fb6522b9-ab3e-411e-afb9-a7fa89baa012 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:21.988776 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fb6522b9-ab3e-411e-afb9-a7fa89baa012 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:21.989382 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fb6522b9-ab3e-411e-afb9-a7fa89baa012 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:21.990444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fb6522b9-ab3e-411e-afb9-a7fa89baa012 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:21.990876 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fb6522b9-ab3e-411e-afb9-a7fa89baa012 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.150154 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fb6522b9-ab3e-411e-afb9-a7fa89baa012 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:22.158608 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fb6522b9-ab3e-411e-afb9-a7fa89baa012 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1568 microversion: 2.1 time: 0.186865 Jun 30 04:21:22.159221 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 371/722] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:21 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:22.168370 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:22.169204 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:22.175068 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1a28c8b6-7958-4db2-a05d-c4e61f387569 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:22.175662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1a28c8b6-7958-4db2-a05d-c4e61f387569 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:22.176757 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.177310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.178315 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.179046 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.182637 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a28c8b6-7958-4db2-a05d-c4e61f387569 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.182865 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a28c8b6-7958-4db2-a05d-c4e61f387569 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.183770 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a28c8b6-7958-4db2-a05d-c4e61f387569 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.184268 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a28c8b6-7958-4db2-a05d-c4e61f387569 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.213356 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.213920 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.214375 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lazy-loading 'fault' on Instance uuid d0a0dbf7-3345-49a9-9785-a36af6da4a5f {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:21:22.262760 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:22.269856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1a28c8b6-7958-4db2-a05d-c4e61f387569 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "POST /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4/action" status: 202 len: 0 microversion: 2.1 time: 0.098618 Jun 30 04:21:22.270467 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 372/723] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:21:22 2022] POST /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 04:21:22.270678 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7b10f284-56d6-4364-b063-305e87c059a3 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 200 len: 1229 microversion: 2.1 time: 0.111238 Jun 30 04:21:22.271803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 352/724] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:22 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:22.283365 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f5b6068d-76b9-4ac3-8c7c-0e11b625e8eb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:22.284079 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f5b6068d-76b9-4ac3-8c7c-0e11b625e8eb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:22.285097 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8380ce2b-f2d2-4371-b3d0-0c311ef7eb8f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:22.285881 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8380ce2b-f2d2-4371-b3d0-0c311ef7eb8f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:22.291232 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f5b6068d-76b9-4ac3-8c7c-0e11b625e8eb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.291802 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f5b6068d-76b9-4ac3-8c7c-0e11b625e8eb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.292672 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8380ce2b-f2d2-4371-b3d0-0c311ef7eb8f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.292816 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f5b6068d-76b9-4ac3-8c7c-0e11b625e8eb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.293167 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8380ce2b-f2d2-4371-b3d0-0c311ef7eb8f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.293356 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f5b6068d-76b9-4ac3-8c7c-0e11b625e8eb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.293922 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8380ce2b-f2d2-4371-b3d0-0c311ef7eb8f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.294379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8380ce2b-f2d2-4371-b3d0-0c311ef7eb8f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.557392 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8380ce2b-f2d2-4371-b3d0-0c311ef7eb8f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:22.562146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f5b6068d-76b9-4ac3-8c7c-0e11b625e8eb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:22.571662 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f5b6068d-76b9-4ac3-8c7c-0e11b625e8eb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:22.572298 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8380ce2b-f2d2-4371-b3d0-0c311ef7eb8f tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1576 microversion: 2.1 time: 0.290663 Jun 30 04:21:22.573087 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 353/725] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:22 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1576 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:22.573221 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f5b6068d-76b9-4ac3-8c7c-0e11b625e8eb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:22.574384 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f5b6068d-76b9-4ac3-8c7c-0e11b625e8eb tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1731 microversion: 2.20 time: 0.302900 Jun 30 04:21:22.575719 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 373/726] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:22 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1731 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:22.580379 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:22.581166 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:22.581332 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-169571e9-bf80-4ffb-9b25-c916658ef1c7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:22.582105 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-169571e9-bf80-4ffb-9b25-c916658ef1c7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:22.591511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-169571e9-bf80-4ffb-9b25-c916658ef1c7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.592374 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-169571e9-bf80-4ffb-9b25-c916658ef1c7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.593343 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-169571e9-bf80-4ffb-9b25-c916658ef1c7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.593811 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-169571e9-bf80-4ffb-9b25-c916658ef1c7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.598262 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.599049 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.600020 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.601103 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.638916 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.639525 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.640172 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lazy-loading 'fault' on Instance uuid 51520645-cd99-466c-83b2-8f735e7d04cf {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:21:22.691447 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-169571e9-bf80-4ffb-9b25-c916658ef1c7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lazy-loading 'services' on Instance uuid 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:21:22.691733 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17540f6ae3234debb5cfe7580f78d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf207393082c48d09f827e16d99b2609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:22.700769 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e8966f70-4dc9-4024-a35a-c037f52267d2 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 200 len: 1348 microversion: 2.1 time: 0.123777 Jun 30 04:21:22.701676 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 374/727] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:22 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 1348 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:22.810208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-169571e9-bf80-4ffb-9b25-c916658ef1c7 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments/41fca21a-168a-48a8-89de-222250bd56c2" status: 202 len: 0 microversion: 2.1 time: 0.235189 Jun 30 04:21:22.810913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 354/728] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:21:22 2022] DELETE /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments/41fca21a-168a-48a8-89de-222250bd56c2 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:21:22.820070 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c73c61cf-83e3-47b2-b255-ced4aa355fee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:22.821054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c73c61cf-83e3-47b2-b255-ced4aa355fee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:22.827453 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c73c61cf-83e3-47b2-b255-ced4aa355fee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.827939 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c73c61cf-83e3-47b2-b255-ced4aa355fee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.828758 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c73c61cf-83e3-47b2-b255-ced4aa355fee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:22.829204 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c73c61cf-83e3-47b2-b255-ced4aa355fee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:22.864127 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c73c61cf-83e3-47b2-b255-ced4aa355fee tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048610 Jun 30 04:21:22.866104 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 375/729] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:21:22 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:23.186812 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-cc0a9b06-425c-4a06-bf87-cc9e7821efa6 req-82cb1f36-4d92-47e1-9959-c0e2513f10cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51354e88-a19f-433f-85b3-126269c921c4", "name": "network-vif-unplugged", "status": "completed", "tag": "90e33ddf-37e0-40e5-ac04-e09a2cb58d98"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:23.197113 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-cc0a9b06-425c-4a06-bf87-cc9e7821efa6 req-82cb1f36-4d92-47e1-9959-c0e2513f10cd service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:23.197561 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-cc0a9b06-425c-4a06-bf87-cc9e7821efa6 req-82cb1f36-4d92-47e1-9959-c0e2513f10cd service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:23.209807 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.compute.server_external_events [req-cc0a9b06-425c-4a06-bf87-cc9e7821efa6 req-82cb1f36-4d92-47e1-9959-c0e2513f10cd service nova] Unable to find a host for instance 51354e88-a19f-433f-85b3-126269c921c4. Dropping event network-vif-unplugged {{(pid=118187) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 04:21:23.210706 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-cc0a9b06-425c-4a06-bf87-cc9e7821efa6 req-82cb1f36-4d92-47e1-9959-c0e2513f10cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029963 Jun 30 04:21:23.211657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 355/730] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 30 04:21:23.288950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-991788d3-0ed3-4153-bbfd-fab3373d7be2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:23.289567 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-991788d3-0ed3-4153-bbfd-fab3373d7be2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:23.296564 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-991788d3-0ed3-4153-bbfd-fab3373d7be2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:23.297128 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-991788d3-0ed3-4153-bbfd-fab3373d7be2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:23.298093 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-991788d3-0ed3-4153-bbfd-fab3373d7be2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:23.298600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-991788d3-0ed3-4153-bbfd-fab3373d7be2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:23.312226 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-991788d3-0ed3-4153-bbfd-fab3373d7be2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] HTTP exception thrown: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-991788d3-0ed3-4153-bbfd-fab3373d7be2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Request method failure captured: Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f HTTP/1.1 Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSPnkigjnICry9tM5IK-uZJQXEazf1odAxsmL38Fj4dgwtESFU0i5J8hq0xkuumOp_ij-eqSifPqeh5PTqBWPfYzWUAGPU3zWVRQzyGieu3Kz42aahhmGZ--CD5kgVDx7UDnKBVhfNmEZGab-LnN1-GDn8peSa2JNWp_IGHVZKr8MlM Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: c2fe0f4b2519494ea784cea098da6be3 Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:21:23.313969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c2fe0f4b2519494ea784cea098da6be3"}]}] Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: c2fe0f4b2519494ea784cea098da6be3 Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-TestVolumeBootPattern-1718480899-project Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: e269c6a656ff4721911ae25657eeedca Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-TestVolumeBootPattern-1718480899-project Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:21:23.315512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': 'd0a0dbf7-3345-49a9-9785-a36af6da4a5f'} Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:21:23.316443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:21:23.317902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:23.319206 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-991788d3-0ed3-4153-bbfd-fab3373d7be2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Returning 404 to user: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:21:23.319206 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-991788d3-0ed3-4153-bbfd-fab3373d7be2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 404 len: 111 microversion: 2.1 time: 0.031924 Jun 30 04:21:23.319206 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 376/731] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:23 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:21:23.424677 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1552309872", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-814051584", "security_groups": [{"name": "tempest-secgroup-smoke-779380356"}], "block_device_mapping_v2": [{"uuid": "8fd904f2-9fe9-4391-8608-87ddd3a2b15c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "db2948ec-060f-4621-8ce6-8119698c91b1"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:23.541466 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] validate_networks() for [('db2948ec-060f-4621-8ce6-8119698c91b1', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:21:23.590595 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3cb294bd-c725-4605-81b2-fb57ebcb238d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:23.591539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3cb294bd-c725-4605-81b2-fb57ebcb238d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:23.597936 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3cb294bd-c725-4605-81b2-fb57ebcb238d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:23.598485 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3cb294bd-c725-4605-81b2-fb57ebcb238d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:23.599386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3cb294bd-c725-4605-81b2-fb57ebcb238d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:23.600010 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3cb294bd-c725-4605-81b2-fb57ebcb238d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:23.829792 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3cb294bd-c725-4605-81b2-fb57ebcb238d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:23.837734 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3cb294bd-c725-4605-81b2-fb57ebcb238d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1516 microversion: 2.1 time: 0.251467 Jun 30 04:21:23.838656 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 377/732] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:23 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:23.843261 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8c53be55-7c85-455e-9c02-e145d1d9609a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:23.843864 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8c53be55-7c85-455e-9c02-e145d1d9609a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:23.850362 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8c53be55-7c85-455e-9c02-e145d1d9609a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:23.850592 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8c53be55-7c85-455e-9c02-e145d1d9609a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:23.851389 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8c53be55-7c85-455e-9c02-e145d1d9609a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:23.851824 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8c53be55-7c85-455e-9c02-e145d1d9609a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:23.870231 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:24.375558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8c53be55-7c85-455e-9c02-e145d1d9609a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:24.399179 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8c53be55-7c85-455e-9c02-e145d1d9609a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:24.401246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8c53be55-7c85-455e-9c02-e145d1d9609a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:24.403433 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8c53be55-7c85-455e-9c02-e145d1d9609a tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1718 microversion: 2.20 time: 0.563645 Jun 30 04:21:24.405045 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 378/733] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:23 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1718 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:21:24.405831 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:21:24.406270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:21:24.407524 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:21:24.407945 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:21:24.408364 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:21:24.412494 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4a203dee-290a-4526-ba10-e91c2a410021 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:24.413549 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4a203dee-290a-4526-ba10-e91c2a410021 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] [instance: 51520645-cd99-466c-83b2-8f735e7d04cf] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:24.420916 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4a203dee-290a-4526-ba10-e91c2a410021 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.421433 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4a203dee-290a-4526-ba10-e91c2a410021 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.422719 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4a203dee-290a-4526-ba10-e91c2a410021 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.423179 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4a203dee-290a-4526-ba10-e91c2a410021 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.426882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.427514 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.428541 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.429405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.439684 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-4a203dee-290a-4526-ba10-e91c2a410021 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] HTTP exception thrown: Instance 51520645-cd99-466c-83b2-8f735e7d04cf could not be found. Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4a203dee-290a-4526-ba10-e91c2a410021 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Request method failure captured: Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf HTTP/1.1 Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSQReKfUbBC7U2lgc8ZUO32BawTbtwf9oUGo43Vm7okOTpO_iMn-Anf4YNFOS_Ce7O-bjMl2J39jhh-JU46aWbdT1MAfMRqCQOalbYvtGeZNanHoKFWBX7ZfAaBsmxC1gg4RaFnP9bIDpu8mvURgnIAIEfPa0Gmso5e7O5JR2OvXXSc Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: bf207393082c48d09f827e16d99b2609 Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-TestMinimumBasicScenario-130177793 Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:21:24.441674 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bf207393082c48d09f827e16d99b2609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bf207393082c48d09f827e16d99b2609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bf207393082c48d09f827e16d99b2609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bf207393082c48d09f827e16d99b2609"}]}] Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-TestMinimumBasicScenario-130177793 Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: bf207393082c48d09f827e16d99b2609 Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-TestMinimumBasicScenario-130177793 Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-TestMinimumBasicScenario-130177793-project Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: 17540f6ae3234debb5cfe7580f78d61d Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-TestMinimumBasicScenario-130177793-project Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 51520645-cd99-466c-83b2-8f735e7d04cf could not be found. Jun 30 04:21:24.443332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '51520645-cd99-466c-83b2-8f735e7d04cf'} Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51520645-cd99-466c-83b2-8f735e7d04cf could not be found. Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:21:24.444311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51520645-cd99-466c-83b2-8f735e7d04cf could not be found. Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51520645-cd99-466c-83b2-8f735e7d04cf could not be found. Jun 30 04:21:24.445754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:21:24.447860 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4a203dee-290a-4526-ba10-e91c2a410021 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Returning 404 to user: Instance 51520645-cd99-466c-83b2-8f735e7d04cf could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:21:24.449466 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4a203dee-290a-4526-ba10-e91c2a410021 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf" status: 404 len: 111 microversion: 2.1 time: 0.042869 Jun 30 04:21:24.450203 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 379/734] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:24 2022] GET /compute/v2.1/servers/51520645-cd99-466c-83b2-8f735e7d04cf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:21:24.454170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Getting quotas for project c2fe0f4b2519494ea784cea098da6be3. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:21:24.456622 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d87a4015-ecf8-4fe8-979e-388a9d3ee2fd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:24.457686 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d87a4015-ecf8-4fe8-979e-388a9d3ee2fd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:24.458255 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Getting quotas for user e269c6a656ff4721911ae25657eeedca and project c2fe0f4b2519494ea784cea098da6be3. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:21:24.464271 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d87a4015-ecf8-4fe8-979e-388a9d3ee2fd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.464803 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d87a4015-ecf8-4fe8-979e-388a9d3ee2fd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.465568 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d87a4015-ecf8-4fe8-979e-388a9d3ee2fd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.466013 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d87a4015-ecf8-4fe8-979e-388a9d3ee2fd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.497940 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d87a4015-ecf8-4fe8-979e-388a9d3ee2fd tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046329 Jun 30 04:21:24.498504 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 380/735] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:21:24 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 04:21:24.502823 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-87591d58-7920-4807-8ca3-c8f554b13cd6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] Calling method '.version_select at 0x7fb4800e3ca0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:24.516176 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:21:24.518449 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8fd904f2-9fe9-4391-8608-87ddd3a2b15c',volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:21:24.520989 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-87591d58-7920-4807-8ca3-c8f554b13cd6 tempest-TestMinimumBasicScenario-130177793 tempest-TestMinimumBasicScenario-130177793-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-297697838" status: 202 len: 0 microversion: 2.1 time: 0.021477 Jun 30 04:21:24.522406 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 381/736] 10.222.0.13 () {58 vars in 1268 bytes} [Thu Jun 30 04:21:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-297697838 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:21:24.578594 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f9486bcc-bc3d-4cdb-9903-e1fdf9fdc708 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:24.579189 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f9486bcc-bc3d-4cdb-9903-e1fdf9fdc708 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:24.590246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9486bcc-bc3d-4cdb-9903-e1fdf9fdc708 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.590959 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9486bcc-bc3d-4cdb-9903-e1fdf9fdc708 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.591758 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9486bcc-bc3d-4cdb-9903-e1fdf9fdc708 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.592188 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9486bcc-bc3d-4cdb-9903-e1fdf9fdc708 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.622555 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f9486bcc-bc3d-4cdb-9903-e1fdf9fdc708 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:21:24.712694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e352ae16-3031-4d8a-bb6f-d5503b5c62fb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.291930 Jun 30 04:21:24.713394 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 356/737] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:21:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:21:24.724190 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8b7e8631-43a0-4b9f-a43b-9bdc5523259f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:24.725624 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8b7e8631-43a0-4b9f-a43b-9bdc5523259f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:24.754902 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f9486bcc-bc3d-4cdb-9903-e1fdf9fdc708 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 204 len: 0 microversion: 2.1 time: 0.180194 Jun 30 04:21:24.755964 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 382/738] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:21:24 2022] DELETE /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 04:21:24.768163 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6fe234e4-f11c-40dd-a64a-0de2a9e2fdb9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:24.775353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6fe234e4-f11c-40dd-a64a-0de2a9e2fdb9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:24.784195 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fe234e4-f11c-40dd-a64a-0de2a9e2fdb9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.785329 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fe234e4-f11c-40dd-a64a-0de2a9e2fdb9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.786186 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fe234e4-f11c-40dd-a64a-0de2a9e2fdb9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.786706 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6fe234e4-f11c-40dd-a64a-0de2a9e2fdb9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.797433 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8b7e8631-43a0-4b9f-a43b-9bdc5523259f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:24.807515 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8b7e8631-43a0-4b9f-a43b-9bdc5523259f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1094 microversion: 2.1 time: 0.087690 Jun 30 04:21:24.808643 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 357/739] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:24 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:24.855552 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-302c85d6-c95e-4cf9-8230-be16d7e9331a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:24.856179 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-302c85d6-c95e-4cf9-8230-be16d7e9331a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:24.864245 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-302c85d6-c95e-4cf9-8230-be16d7e9331a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.864818 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-302c85d6-c95e-4cf9-8230-be16d7e9331a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.866072 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-302c85d6-c95e-4cf9-8230-be16d7e9331a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:24.866894 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-302c85d6-c95e-4cf9-8230-be16d7e9331a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:24.874446 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:25.001319 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6fe234e4-f11c-40dd-a64a-0de2a9e2fdb9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:25.011398 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6fe234e4-f11c-40dd-a64a-0de2a9e2fdb9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1691 microversion: 2.1 time: 0.250897 Jun 30 04:21:25.012659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 383/740] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:24 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:25.065766 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-302c85d6-c95e-4cf9-8230-be16d7e9331a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:25.074538 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-302c85d6-c95e-4cf9-8230-be16d7e9331a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1518 microversion: 2.1 time: 0.223303 Jun 30 04:21:25.076584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 358/741] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:24 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1518 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:25.824275 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-29ff9caa-909b-4e93-8f25-c434ea602205 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:25.824856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-29ff9caa-909b-4e93-8f25-c434ea602205 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:25.831906 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-29ff9caa-909b-4e93-8f25-c434ea602205 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:25.832385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-29ff9caa-909b-4e93-8f25-c434ea602205 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:25.833141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-29ff9caa-909b-4e93-8f25-c434ea602205 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:25.833694 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-29ff9caa-909b-4e93-8f25-c434ea602205 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:25.895243 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-29ff9caa-909b-4e93-8f25-c434ea602205 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:25.903599 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-29ff9caa-909b-4e93-8f25-c434ea602205 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1144 microversion: 2.1 time: 0.083159 Jun 30 04:21:25.904160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 384/742] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:25 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:26.033264 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1ebbb736-cf16-454c-8e2d-c8a8b00837a1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:26.033855 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1ebbb736-cf16-454c-8e2d-c8a8b00837a1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:26.045210 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ebbb736-cf16-454c-8e2d-c8a8b00837a1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:26.046227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ebbb736-cf16-454c-8e2d-c8a8b00837a1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:26.047725 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ebbb736-cf16-454c-8e2d-c8a8b00837a1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:26.048545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1ebbb736-cf16-454c-8e2d-c8a8b00837a1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:26.093435 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-033a5237-bef2-40b9-9db8-14c5a589b4f4 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:26.094046 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-033a5237-bef2-40b9-9db8-14c5a589b4f4 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:26.103263 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-033a5237-bef2-40b9-9db8-14c5a589b4f4 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:26.104107 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-033a5237-bef2-40b9-9db8-14c5a589b4f4 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:26.105114 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-033a5237-bef2-40b9-9db8-14c5a589b4f4 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:26.105903 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-033a5237-bef2-40b9-9db8-14c5a589b4f4 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:26.238957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1ebbb736-cf16-454c-8e2d-c8a8b00837a1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:26.247964 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1ebbb736-cf16-454c-8e2d-c8a8b00837a1 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1691 microversion: 2.1 time: 0.218655 Jun 30 04:21:26.258446 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 359/743] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:26 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1691 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:26.290671 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-033a5237-bef2-40b9-9db8-14c5a589b4f4 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:26.298958 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-033a5237-bef2-40b9-9db8-14c5a589b4f4 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1518 microversion: 2.1 time: 0.209283 Jun 30 04:21:26.299568 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 385/744] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:26 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1518 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:26.920890 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-62c14a15-1963-4f29-8b3c-2ef55bf4a91f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:26.921701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-62c14a15-1963-4f29-8b3c-2ef55bf4a91f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:26.928314 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-62c14a15-1963-4f29-8b3c-2ef55bf4a91f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:26.928736 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-62c14a15-1963-4f29-8b3c-2ef55bf4a91f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:26.929799 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-62c14a15-1963-4f29-8b3c-2ef55bf4a91f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:26.930270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-62c14a15-1963-4f29-8b3c-2ef55bf4a91f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:26.995738 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-62c14a15-1963-4f29-8b3c-2ef55bf4a91f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:27.003201 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-62c14a15-1963-4f29-8b3c-2ef55bf4a91f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1144 microversion: 2.1 time: 0.086196 Jun 30 04:21:27.003854 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 360/745] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:26 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:27.265989 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-af51b11e-c0f4-4bb5-a646-53303b1f875f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:27.266608 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-af51b11e-c0f4-4bb5-a646-53303b1f875f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:27.279969 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-af51b11e-c0f4-4bb5-a646-53303b1f875f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:27.280416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-af51b11e-c0f4-4bb5-a646-53303b1f875f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:27.281186 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-af51b11e-c0f4-4bb5-a646-53303b1f875f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:27.281617 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-af51b11e-c0f4-4bb5-a646-53303b1f875f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:27.316419 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bc22ea47-e465-44de-b423-6c968497e639 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:27.317018 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bc22ea47-e465-44de-b423-6c968497e639 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:27.324594 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc22ea47-e465-44de-b423-6c968497e639 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:27.325031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc22ea47-e465-44de-b423-6c968497e639 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:27.325787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc22ea47-e465-44de-b423-6c968497e639 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:27.326211 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc22ea47-e465-44de-b423-6c968497e639 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:27.635511 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-af51b11e-c0f4-4bb5-a646-53303b1f875f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:27.643968 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-af51b11e-c0f4-4bb5-a646-53303b1f875f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1691 microversion: 2.1 time: 0.381706 Jun 30 04:21:27.645236 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 386/746] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:27 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1691 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:27.694579 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bc22ea47-e465-44de-b423-6c968497e639 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:27.702850 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bc22ea47-e465-44de-b423-6c968497e639 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1518 microversion: 2.1 time: 0.390235 Jun 30 04:21:27.703625 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 361/747] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:27 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1518 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:28.023499 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bb4ecb18-aa43-47c3-8594-7b7fc1552eed tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:28.024149 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-bb4ecb18-aa43-47c3-8594-7b7fc1552eed tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:28.030901 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bb4ecb18-aa43-47c3-8594-7b7fc1552eed tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:28.031410 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bb4ecb18-aa43-47c3-8594-7b7fc1552eed tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:28.032199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bb4ecb18-aa43-47c3-8594-7b7fc1552eed tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:28.032640 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bb4ecb18-aa43-47c3-8594-7b7fc1552eed tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:28.101869 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-bb4ecb18-aa43-47c3-8594-7b7fc1552eed tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:28.112012 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bb4ecb18-aa43-47c3-8594-7b7fc1552eed tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1192 microversion: 2.1 time: 0.093789 Jun 30 04:21:28.125828 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 387/748] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:28 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:28.665623 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-245fa164-c925-4f0a-900f-f618d6235e1e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:28.667142 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-245fa164-c925-4f0a-900f-f618d6235e1e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:28.679376 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-245fa164-c925-4f0a-900f-f618d6235e1e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:28.680261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-245fa164-c925-4f0a-900f-f618d6235e1e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:28.682736 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-245fa164-c925-4f0a-900f-f618d6235e1e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:28.683529 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-245fa164-c925-4f0a-900f-f618d6235e1e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:28.723937 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-557e6581-062d-4676-9ff0-34d3de4030a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:28.725659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-557e6581-062d-4676-9ff0-34d3de4030a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:28.737171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-557e6581-062d-4676-9ff0-34d3de4030a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:28.737842 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-557e6581-062d-4676-9ff0-34d3de4030a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:28.738915 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-557e6581-062d-4676-9ff0-34d3de4030a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:28.739667 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-557e6581-062d-4676-9ff0-34d3de4030a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:29.231129 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-245fa164-c925-4f0a-900f-f618d6235e1e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:29.243113 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-245fa164-c925-4f0a-900f-f618d6235e1e tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1691 microversion: 2.1 time: 0.584364 Jun 30 04:21:29.252890 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 362/749] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:28 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1691 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:29.258143 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-801c647c-d42f-4186-8c5f-79a59ef5895e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:29.258765 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-801c647c-d42f-4186-8c5f-79a59ef5895e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:29.265212 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-557e6581-062d-4676-9ff0-34d3de4030a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:29.265989 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-801c647c-d42f-4186-8c5f-79a59ef5895e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:29.266709 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-801c647c-d42f-4186-8c5f-79a59ef5895e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:29.267613 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-801c647c-d42f-4186-8c5f-79a59ef5895e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:29.268043 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-801c647c-d42f-4186-8c5f-79a59ef5895e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:29.286410 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-557e6581-062d-4676-9ff0-34d3de4030a6 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.566193 Jun 30 04:21:29.287940 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 388/750] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:28 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:29.468911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-801c647c-d42f-4186-8c5f-79a59ef5895e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:29.481850 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-801c647c-d42f-4186-8c5f-79a59ef5895e tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1198 microversion: 2.1 time: 0.231990 Jun 30 04:21:29.482441 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 363/751] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:29 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1198 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:30.262830 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d8304666-0e8e-4192-9d66-89930e9e95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:30.263621 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d8304666-0e8e-4192-9d66-89930e9e95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:30.270746 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8304666-0e8e-4192-9d66-89930e9e95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:30.272391 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8304666-0e8e-4192-9d66-89930e9e95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:30.273422 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8304666-0e8e-4192-9d66-89930e9e95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:30.273957 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8304666-0e8e-4192-9d66-89930e9e95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:30.306606 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-53c60bb4-bccd-4ff6-99a4-775dd3e16cd7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:30.310066 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-53c60bb4-bccd-4ff6-99a4-775dd3e16cd7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:30.319390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53c60bb4-bccd-4ff6-99a4-775dd3e16cd7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:30.319813 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53c60bb4-bccd-4ff6-99a4-775dd3e16cd7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:30.320783 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53c60bb4-bccd-4ff6-99a4-775dd3e16cd7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:30.321361 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53c60bb4-bccd-4ff6-99a4-775dd3e16cd7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:30.481055 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d8304666-0e8e-4192-9d66-89930e9e95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:30.496962 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d8304666-0e8e-4192-9d66-89930e9e95db tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 200 len: 1624 microversion: 2.1 time: 0.239383 Jun 30 04:21:30.497886 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 389/752] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:30 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 1624 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:30.512830 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-202eb727-9c96-4a39-8715-0841d98e6ec5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:30.515889 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-202eb727-9c96-4a39-8715-0841d98e6ec5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:30.526667 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-202eb727-9c96-4a39-8715-0841d98e6ec5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:30.527568 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-202eb727-9c96-4a39-8715-0841d98e6ec5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:30.528512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-202eb727-9c96-4a39-8715-0841d98e6ec5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:30.530087 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-202eb727-9c96-4a39-8715-0841d98e6ec5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:30.663230 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-202eb727-9c96-4a39-8715-0841d98e6ec5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:30.678832 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-202eb727-9c96-4a39-8715-0841d98e6ec5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1198 microversion: 2.1 time: 0.178717 Jun 30 04:21:30.688982 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 390/753] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:30 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1198 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:30.824981 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-53c60bb4-bccd-4ff6-99a4-775dd3e16cd7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:30.828836 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-8857d095-077f-485c-b557-cb8ff00c0058 req-268496d1-72bd-4723-b46b-de42bdbb76c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99", "name": "network-vif-deleted", "tag": "2a4fd84e-fb19-4d1c-b772-2251c8322151"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:30.833122 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-53c60bb4-bccd-4ff6-99a4-775dd3e16cd7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.533802 Jun 30 04:21:30.837916 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 364/754] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:30 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:30.848805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-8857d095-077f-485c-b557-cb8ff00c0058 req-268496d1-72bd-4723-b46b-de42bdbb76c0 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:30.849686 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-8857d095-077f-485c-b557-cb8ff00c0058 req-268496d1-72bd-4723-b46b-de42bdbb76c0 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:30.884888 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-8857d095-077f-485c-b557-cb8ff00c0058 req-268496d1-72bd-4723-b46b-de42bdbb76c0 service nova] Creating event network-vif-deleted:2a4fd84e-fb19-4d1c-b772-2251c8322151 for instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 on hv-cinder-84684 Jun 30 04:21:30.909498 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-8857d095-077f-485c-b557-cb8ff00c0058 req-268496d1-72bd-4723-b46b-de42bdbb76c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091156 Jun 30 04:21:30.911068 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 391/755] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:31.514028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ffe6d2c1-b064-4ac1-a511-a92e88eff29c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:31.514667 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ffe6d2c1-b064-4ac1-a511-a92e88eff29c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:31.527329 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ffe6d2c1-b064-4ac1-a511-a92e88eff29c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:31.527869 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ffe6d2c1-b064-4ac1-a511-a92e88eff29c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:31.531596 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ffe6d2c1-b064-4ac1-a511-a92e88eff29c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:31.532463 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ffe6d2c1-b064-4ac1-a511-a92e88eff29c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:31.564583 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-ffe6d2c1-b064-4ac1-a511-a92e88eff29c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] HTTP exception thrown: Instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 could not be found. Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ffe6d2c1-b064-4ac1-a511-a92e88eff29c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Request method failure captured: Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 HTTP/1.1 Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSOgW5TdQdIDnKRvRN6OMIhpIxAn2TKObfMVZ_JlbTYawaWtUqJSBAcUwPpiMbmhabkYxhVFA8mAfsXKkBB-sLhYFC6mMr2p3YJrMJjtEXUPxpHpeI0lkKEnL1xpp2Dw8Df0bDRkrrlKKYAeqTbtfqBunbiYcSLFxb4qb3NxzJ1LYcs Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 74b53f46d15c4465b9005939114e67a3 Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:21:31.571028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74b53f46d15c4465b9005939114e67a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_74b53f46d15c4465b9005939114e67a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74b53f46d15c4465b9005939114e67a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/74b53f46d15c4465b9005939114e67a3"}]}] Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 74b53f46d15c4465b9005939114e67a3 Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-ServerRescueNegativeTestJSON-1003299466-project Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: b6854699a1dc475ab11a89bcaf2af85a Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1003299466-project Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 could not be found. Jun 30 04:21:31.572727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99'} Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 could not be found. Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:21:31.574139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 could not be found. Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 could not be found. Jun 30 04:21:31.575657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:31.578154 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ffe6d2c1-b064-4ac1-a511-a92e88eff29c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Returning 404 to user: Instance 8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:21:31.579287 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ffe6d2c1-b064-4ac1-a511-a92e88eff29c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99" status: 404 len: 111 microversion: 2.1 time: 0.069357 Jun 30 04:21:31.580714 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 365/756] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:31 2022] GET /compute/v2.1/servers/8cc38d9c-363d-4a90-a5a3-2f16ee1f8a99 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:21:31.590389 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f10a5482-471d-4dfc-925d-bdfa5b84d629 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '.version_select at 0x7fb48017b790>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:31.616150 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f10a5482-471d-4dfc-925d-bdfa5b84d629 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920684319" status: 202 len: 0 microversion: 2.1 time: 0.029964 Jun 30 04:21:31.619164 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 392/757] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 30 04:21:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920684319 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:21:31.704871 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4a9e5302-545f-4356-a90d-688d6bedb065 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:31.705482 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4a9e5302-545f-4356-a90d-688d6bedb065 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:31.713623 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a9e5302-545f-4356-a90d-688d6bedb065 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:31.714376 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a9e5302-545f-4356-a90d-688d6bedb065 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:31.718827 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a9e5302-545f-4356-a90d-688d6bedb065 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:31.719506 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4a9e5302-545f-4356-a90d-688d6bedb065 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:31.855574 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-08e4608a-eda4-4e90-ad81-01ccf4eaa891 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:31.856520 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-08e4608a-eda4-4e90-ad81-01ccf4eaa891 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:31.862853 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-08e4608a-eda4-4e90-ad81-01ccf4eaa891 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:31.864218 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-08e4608a-eda4-4e90-ad81-01ccf4eaa891 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:31.865358 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-08e4608a-eda4-4e90-ad81-01ccf4eaa891 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:31.866244 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-08e4608a-eda4-4e90-ad81-01ccf4eaa891 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:32.106387 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4a9e5302-545f-4356-a90d-688d6bedb065 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:32.114547 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4a9e5302-545f-4356-a90d-688d6bedb065 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.413521 Jun 30 04:21:32.116348 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 366/758] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:31 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:32.215645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-08e4608a-eda4-4e90-ad81-01ccf4eaa891 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:32.231595 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-08e4608a-eda4-4e90-ad81-01ccf4eaa891 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.374056 Jun 30 04:21:32.232687 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 393/759] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:31 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:32.928529 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-5a1f1b99-386f-4152-9627-f6ed9ea05b23 req-c2114a8d-f784-43cd-9234-dd737b234091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "997a86f0-800e-427c-91a4-9c6a7c8f7fff", "tag": "231a2e75-10e5-4ba7-b633-e79d395e40f4"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:32.937545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-5a1f1b99-386f-4152-9627-f6ed9ea05b23 req-c2114a8d-f784-43cd-9234-dd737b234091 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:32.938083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-5a1f1b99-386f-4152-9627-f6ed9ea05b23 req-c2114a8d-f784-43cd-9234-dd737b234091 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:32.949751 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-5a1f1b99-386f-4152-9627-f6ed9ea05b23 req-c2114a8d-f784-43cd-9234-dd737b234091 service nova] Creating event network-changed:231a2e75-10e5-4ba7-b633-e79d395e40f4 for instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff on hv-cinder-84684 Jun 30 04:21:32.955134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-5a1f1b99-386f-4152-9627-f6ed9ea05b23 req-c2114a8d-f784-43cd-9234-dd737b234091 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031576 Jun 30 04:21:32.956302 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 367/760] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:33.133805 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-29c74f04-7bd6-426e-9c11-449fbff6d03d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:33.134506 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-29c74f04-7bd6-426e-9c11-449fbff6d03d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:33.141623 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-29c74f04-7bd6-426e-9c11-449fbff6d03d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:33.142162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-29c74f04-7bd6-426e-9c11-449fbff6d03d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:33.143003 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-29c74f04-7bd6-426e-9c11-449fbff6d03d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:33.143553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-29c74f04-7bd6-426e-9c11-449fbff6d03d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:33.254563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4e478fd2-314f-4768-b168-17e9619cdd84 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:33.254563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4e478fd2-314f-4768-b168-17e9619cdd84 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:33.273106 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4e478fd2-314f-4768-b168-17e9619cdd84 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:33.274019 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4e478fd2-314f-4768-b168-17e9619cdd84 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:33.277690 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4e478fd2-314f-4768-b168-17e9619cdd84 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:33.279381 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4e478fd2-314f-4768-b168-17e9619cdd84 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:33.352710 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-29c74f04-7bd6-426e-9c11-449fbff6d03d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:33.364689 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-29c74f04-7bd6-426e-9c11-449fbff6d03d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.236124 Jun 30 04:21:33.366784 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 394/761] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:33 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:33.550727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4e478fd2-314f-4768-b168-17e9619cdd84 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:33.559406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4e478fd2-314f-4768-b168-17e9619cdd84 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.313754 Jun 30 04:21:33.569399 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 368/762] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:33 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:34.382632 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ebd98e01-7fbc-4306-9d01-fc52546e9633 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:34.383498 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ebd98e01-7fbc-4306-9d01-fc52546e9633 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:34.391470 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ebd98e01-7fbc-4306-9d01-fc52546e9633 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:34.391984 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ebd98e01-7fbc-4306-9d01-fc52546e9633 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:34.392877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ebd98e01-7fbc-4306-9d01-fc52546e9633 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:34.393312 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ebd98e01-7fbc-4306-9d01-fc52546e9633 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:34.555800 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ebd98e01-7fbc-4306-9d01-fc52546e9633 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:34.564246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ebd98e01-7fbc-4306-9d01-fc52546e9633 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.185821 Jun 30 04:21:34.564845 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 395/763] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:34 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:34.576933 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b1319794-04ab-407a-9b85-00f2b4b90164 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:34.577572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b1319794-04ab-407a-9b85-00f2b4b90164 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:34.580709 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:34.587695 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1319794-04ab-407a-9b85-00f2b4b90164 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:34.588137 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1319794-04ab-407a-9b85-00f2b4b90164 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:34.588915 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1319794-04ab-407a-9b85-00f2b4b90164 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:34.589415 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1319794-04ab-407a-9b85-00f2b4b90164 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:34.727643 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b1319794-04ab-407a-9b85-00f2b4b90164 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:34.735072 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b1319794-04ab-407a-9b85-00f2b4b90164 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.162145 Jun 30 04:21:34.735661 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 369/764] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:34 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:35.568060 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-570909e1-ee1d-4145-ab93-be532bf1a563 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:35.568580 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-570909e1-ee1d-4145-ab93-be532bf1a563 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:35.575617 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-570909e1-ee1d-4145-ab93-be532bf1a563 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:35.576058 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-570909e1-ee1d-4145-ab93-be532bf1a563 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:35.576820 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-570909e1-ee1d-4145-ab93-be532bf1a563 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:35.577246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-570909e1-ee1d-4145-ab93-be532bf1a563 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:35.581841 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f3c005d8-1682-4d89-86f3-48846d1af7f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:35.582425 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f3c005d8-1682-4d89-86f3-48846d1af7f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:35.584698 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=8 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:35.591290 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3c005d8-1682-4d89-86f3-48846d1af7f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:35.591734 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3c005d8-1682-4d89-86f3-48846d1af7f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:35.592501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3c005d8-1682-4d89-86f3-48846d1af7f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:35.592951 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3c005d8-1682-4d89-86f3-48846d1af7f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:35.603552 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-570909e1-ee1d-4145-ab93-be532bf1a563 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:21:35.607123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:35.696984 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-570909e1-ee1d-4145-ab93-be532bf1a563 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 204 len: 0 microversion: 2.1 time: 0.132483 Jun 30 04:21:35.697707 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 396/765] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:21:35 2022] DELETE /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:21:35.706539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-68d2db9b-5a7b-4fe7-ab7a-901ec5c436ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:35.707276 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-68d2db9b-5a7b-4fe7-ab7a-901ec5c436ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:35.714111 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-68d2db9b-5a7b-4fe7-ab7a-901ec5c436ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:35.714550 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-68d2db9b-5a7b-4fe7-ab7a-901ec5c436ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:35.715595 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-68d2db9b-5a7b-4fe7-ab7a-901ec5c436ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:35.716025 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-68d2db9b-5a7b-4fe7-ab7a-901ec5c436ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:35.911486 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-68d2db9b-5a7b-4fe7-ab7a-901ec5c436ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:35.919724 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-68d2db9b-5a7b-4fe7-ab7a-901ec5c436ce tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1507 microversion: 2.1 time: 0.217425 Jun 30 04:21:35.920391 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 397/766] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:35 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:35.925104 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7d5ac541-e343-433e-9128-d05df5026836 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:35.925707 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7d5ac541-e343-433e-9128-d05df5026836 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:35.927941 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f3c005d8-1682-4d89-86f3-48846d1af7f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:35.931970 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d5ac541-e343-433e-9128-d05df5026836 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:35.932416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d5ac541-e343-433e-9128-d05df5026836 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:35.933178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d5ac541-e343-433e-9128-d05df5026836 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:35.933613 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7d5ac541-e343-433e-9128-d05df5026836 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:35.935789 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f3c005d8-1682-4d89-86f3-48846d1af7f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.357980 Jun 30 04:21:35.936529 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 370/767] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:35 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:36.080416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7d5ac541-e343-433e-9128-d05df5026836 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:36.090845 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7d5ac541-e343-433e-9128-d05df5026836 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.169432 Jun 30 04:21:36.091523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 398/768] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:35 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:36.941541 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8a65a548-9dd6-4cce-a436-ee900c6d3e61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:36.942408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8a65a548-9dd6-4cce-a436-ee900c6d3e61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:36.954248 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a65a548-9dd6-4cce-a436-ee900c6d3e61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:36.954985 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a65a548-9dd6-4cce-a436-ee900c6d3e61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:36.956285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a65a548-9dd6-4cce-a436-ee900c6d3e61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:36.956523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6c3a08dc-28f9-4504-8484-1e46def0f0bc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:36.957181 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a65a548-9dd6-4cce-a436-ee900c6d3e61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:36.957497 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6c3a08dc-28f9-4504-8484-1e46def0f0bc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:36.965276 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c3a08dc-28f9-4504-8484-1e46def0f0bc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:36.965723 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c3a08dc-28f9-4504-8484-1e46def0f0bc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:36.966507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c3a08dc-28f9-4504-8484-1e46def0f0bc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:36.966963 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c3a08dc-28f9-4504-8484-1e46def0f0bc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:37.155615 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8a65a548-9dd6-4cce-a436-ee900c6d3e61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:37.158932 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6c3a08dc-28f9-4504-8484-1e46def0f0bc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:37.163512 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8a65a548-9dd6-4cce-a436-ee900c6d3e61 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1507 microversion: 2.1 time: 0.228609 Jun 30 04:21:37.164159 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 371/769] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:36 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:37.168567 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-09567efa-31c7-4d5c-ad90-9e84dcdb9039 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:37.169157 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-09567efa-31c7-4d5c-ad90-9e84dcdb9039 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:37.169675 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6c3a08dc-28f9-4504-8484-1e46def0f0bc tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.219544 Jun 30 04:21:37.170439 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 399/770] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:36 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:37.175251 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09567efa-31c7-4d5c-ad90-9e84dcdb9039 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:37.175700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09567efa-31c7-4d5c-ad90-9e84dcdb9039 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:37.176430 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09567efa-31c7-4d5c-ad90-9e84dcdb9039 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:37.176854 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09567efa-31c7-4d5c-ad90-9e84dcdb9039 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:37.311771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-09567efa-31c7-4d5c-ad90-9e84dcdb9039 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:37.320050 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-09567efa-31c7-4d5c-ad90-9e84dcdb9039 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.154879 Jun 30 04:21:37.320666 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 372/771] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:37 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:38.180509 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-06ea786b-18b5-40e0-9c7b-9190c3773e3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:38.181124 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-06ea786b-18b5-40e0-9c7b-9190c3773e3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:38.186605 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2ea949b4-e503-40f0-a3fb-1e872f542ec8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:38.187243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2ea949b4-e503-40f0-a3fb-1e872f542ec8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:38.188210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06ea786b-18b5-40e0-9c7b-9190c3773e3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:38.188660 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06ea786b-18b5-40e0-9c7b-9190c3773e3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:38.189538 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06ea786b-18b5-40e0-9c7b-9190c3773e3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:38.189971 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06ea786b-18b5-40e0-9c7b-9190c3773e3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:38.193887 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2ea949b4-e503-40f0-a3fb-1e872f542ec8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:38.194563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2ea949b4-e503-40f0-a3fb-1e872f542ec8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:38.195270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2ea949b4-e503-40f0-a3fb-1e872f542ec8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:38.195699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2ea949b4-e503-40f0-a3fb-1e872f542ec8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:38.390900 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-06ea786b-18b5-40e0-9c7b-9190c3773e3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:38.395376 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2ea949b4-e503-40f0-a3fb-1e872f542ec8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:38.399496 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-06ea786b-18b5-40e0-9c7b-9190c3773e3f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1507 microversion: 2.1 time: 0.223132 Jun 30 04:21:38.400083 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 400/772] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:38 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:38.403392 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2ea949b4-e503-40f0-a3fb-1e872f542ec8 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.220638 Jun 30 04:21:38.404090 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 373/773] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:38 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:38.411014 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1736ec65-d04d-4aa0-aaea-c5d7889db682 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:38.411780 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1736ec65-d04d-4aa0-aaea-c5d7889db682 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:38.417893 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1736ec65-d04d-4aa0-aaea-c5d7889db682 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:38.418349 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1736ec65-d04d-4aa0-aaea-c5d7889db682 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:38.419119 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1736ec65-d04d-4aa0-aaea-c5d7889db682 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:38.419563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1736ec65-d04d-4aa0-aaea-c5d7889db682 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:38.584911 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1736ec65-d04d-4aa0-aaea-c5d7889db682 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:38.592844 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1736ec65-d04d-4aa0-aaea-c5d7889db682 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.191615 Jun 30 04:21:38.593431 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 401/774] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:38 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:39.418167 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ca35ab6d-f055-443d-9b21-6c28ad42c76f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:39.418939 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ca35ab6d-f055-443d-9b21-6c28ad42c76f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:39.419202 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f9266d55-61de-417c-817b-5c476804f566 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:39.419852 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f9266d55-61de-417c-817b-5c476804f566 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:39.422449 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:39.425818 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca35ab6d-f055-443d-9b21-6c28ad42c76f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:39.426322 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca35ab6d-f055-443d-9b21-6c28ad42c76f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:39.427028 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca35ab6d-f055-443d-9b21-6c28ad42c76f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:39.427482 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca35ab6d-f055-443d-9b21-6c28ad42c76f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:39.427964 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9266d55-61de-417c-817b-5c476804f566 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:39.428768 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9266d55-61de-417c-817b-5c476804f566 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:39.429559 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9266d55-61de-417c-817b-5c476804f566 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:39.429997 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f9266d55-61de-417c-817b-5c476804f566 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:39.733081 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ca35ab6d-f055-443d-9b21-6c28ad42c76f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:39.742167 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ca35ab6d-f055-443d-9b21-6c28ad42c76f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 200 len: 1507 microversion: 2.1 time: 0.327809 Jun 30 04:21:39.743882 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f9266d55-61de-417c-817b-5c476804f566 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:39.752205 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 374/775] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:39 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:39.752876 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f9266d55-61de-417c-817b-5c476804f566 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.337223 Jun 30 04:21:39.757551 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8b285d78-f6cf-4348-b908-912a9a166065 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:39.758184 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8b285d78-f6cf-4348-b908-912a9a166065 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:39.762060 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 402/776] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:39 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:39.765117 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b285d78-f6cf-4348-b908-912a9a166065 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:39.765633 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b285d78-f6cf-4348-b908-912a9a166065 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:39.766478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b285d78-f6cf-4348-b908-912a9a166065 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:39.767124 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b285d78-f6cf-4348-b908-912a9a166065 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:39.973875 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8b285d78-f6cf-4348-b908-912a9a166065 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:39.982389 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8b285d78-f6cf-4348-b908-912a9a166065 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.229004 Jun 30 04:21:39.983172 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 375/777] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:39 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:40.028171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-4f84632b-6f4b-4742-9af2-633244b190e9 req-d4235dd9-6357-4f41-8812-ce65d339fe1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1faec7e8-1e39-47c4-aba5-2e67eaf2936c", "name": "network-vif-deleted", "tag": "fca67734-6bd5-404d-9a44-a44b374bc3a8"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:40.037995 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-4f84632b-6f4b-4742-9af2-633244b190e9 req-d4235dd9-6357-4f41-8812-ce65d339fe1e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:40.038532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-4f84632b-6f4b-4742-9af2-633244b190e9 req-d4235dd9-6357-4f41-8812-ce65d339fe1e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:40.050449 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-4f84632b-6f4b-4742-9af2-633244b190e9 req-d4235dd9-6357-4f41-8812-ce65d339fe1e service nova] Creating event network-vif-deleted:fca67734-6bd5-404d-9a44-a44b374bc3a8 for instance 1faec7e8-1e39-47c4-aba5-2e67eaf2936c on hv-cinder-84684 Jun 30 04:21:40.056307 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-4f84632b-6f4b-4742-9af2-633244b190e9 req-d4235dd9-6357-4f41-8812-ce65d339fe1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032121 Jun 30 04:21:40.057101 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 403/778] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:40.760927 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a0e25e6b-6410-427f-b250-5c9dde7d7c5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:40.761532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a0e25e6b-6410-427f-b250-5c9dde7d7c5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: 1faec7e8-1e39-47c4-aba5-2e67eaf2936c] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:40.763972 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:40.769810 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0e25e6b-6410-427f-b250-5c9dde7d7c5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:40.770258 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0e25e6b-6410-427f-b250-5c9dde7d7c5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:40.770920 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-71fdf354-af4f-4bda-afde-45e0375d1569 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:40.771512 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0e25e6b-6410-427f-b250-5c9dde7d7c5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:40.771512 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0e25e6b-6410-427f-b250-5c9dde7d7c5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:40.771697 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-71fdf354-af4f-4bda-afde-45e0375d1569 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:40.775432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:40.779481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-71fdf354-af4f-4bda-afde-45e0375d1569 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:40.779997 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-71fdf354-af4f-4bda-afde-45e0375d1569 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:40.780769 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-71fdf354-af4f-4bda-afde-45e0375d1569 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:40.781194 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-71fdf354-af4f-4bda-afde-45e0375d1569 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:40.790862 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-a0e25e6b-6410-427f-b250-5c9dde7d7c5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] HTTP exception thrown: Instance 1faec7e8-1e39-47c4-aba5-2e67eaf2936c could not be found. Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a0e25e6b-6410-427f-b250-5c9dde7d7c5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Request method failure captured: Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c HTTP/1.1 Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSOgW5TdQdIDnKRvRN6OMIhpIxAn2TKObfMVZ_JlbTYawaWtUqJSBAcUwPpiMbmhabkYxhVFA8mAfsXKkBB-sLhYFC6mMr2p3YJrMJjtEXUPxpHpeI0lkKEnL1xpp2Dw8Df0bDRkrrlKKYAeqTbtfqBunbiYcSLFxb4qb3NxzJ1LYcs Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 74b53f46d15c4465b9005939114e67a3 Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:21:40.792563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74b53f46d15c4465b9005939114e67a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_74b53f46d15c4465b9005939114e67a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74b53f46d15c4465b9005939114e67a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/74b53f46d15c4465b9005939114e67a3"}]}] Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 74b53f46d15c4465b9005939114e67a3 Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-ServerRescueNegativeTestJSON-1003299466-project Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: b6854699a1dc475ab11a89bcaf2af85a Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1003299466-project Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 1faec7e8-1e39-47c4-aba5-2e67eaf2936c could not be found. Jun 30 04:21:40.794082 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '1faec7e8-1e39-47c4-aba5-2e67eaf2936c'} Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1faec7e8-1e39-47c4-aba5-2e67eaf2936c could not be found. Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:21:40.798085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1faec7e8-1e39-47c4-aba5-2e67eaf2936c could not be found. Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1faec7e8-1e39-47c4-aba5-2e67eaf2936c could not be found. Jun 30 04:21:40.799574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:40.800819 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a0e25e6b-6410-427f-b250-5c9dde7d7c5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Returning 404 to user: Instance 1faec7e8-1e39-47c4-aba5-2e67eaf2936c could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:21:40.800819 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a0e25e6b-6410-427f-b250-5c9dde7d7c5a tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c" status: 404 len: 111 microversion: 2.1 time: 0.037265 Jun 30 04:21:40.800819 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 376/779] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:40 2022] GET /compute/v2.1/servers/1faec7e8-1e39-47c4-aba5-2e67eaf2936c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:21:40.803034 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6af87cc8-314d-4a00-9979-b73ef87dbcdc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:40.803558 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6af87cc8-314d-4a00-9979-b73ef87dbcdc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:40.809975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6af87cc8-314d-4a00-9979-b73ef87dbcdc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:40.810423 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6af87cc8-314d-4a00-9979-b73ef87dbcdc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:40.811216 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6af87cc8-314d-4a00-9979-b73ef87dbcdc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:40.811655 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6af87cc8-314d-4a00-9979-b73ef87dbcdc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:40.837178 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6af87cc8-314d-4a00-9979-b73ef87dbcdc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:21:40.917778 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6af87cc8-314d-4a00-9979-b73ef87dbcdc tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 204 len: 0 microversion: 2.1 time: 0.118752 Jun 30 04:21:40.917925 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-71fdf354-af4f-4bda-afde-45e0375d1569 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:40.918547 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 377/780] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:21:40 2022] DELETE /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:21:40.926506 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-71fdf354-af4f-4bda-afde-45e0375d1569 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.159811 Jun 30 04:21:40.927079 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 404/781] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:40 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:40.928775 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-73476ad1-3267-4376-9167-ea59775daa9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:40.929503 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-73476ad1-3267-4376-9167-ea59775daa9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:40.935740 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73476ad1-3267-4376-9167-ea59775daa9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:40.936816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73476ad1-3267-4376-9167-ea59775daa9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:40.937873 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73476ad1-3267-4376-9167-ea59775daa9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:40.938299 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73476ad1-3267-4376-9167-ea59775daa9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:41.002661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-bd02c8ca-d9b8-415b-80ce-8063f1409856 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:41.003948 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-bd02c8ca-d9b8-415b-80ce-8063f1409856 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:41.012947 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bd02c8ca-d9b8-415b-80ce-8063f1409856 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:41.013635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bd02c8ca-d9b8-415b-80ce-8063f1409856 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:41.014869 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bd02c8ca-d9b8-415b-80ce-8063f1409856 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:41.015602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-bd02c8ca-d9b8-415b-80ce-8063f1409856 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:41.085594 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-73476ad1-3267-4376-9167-ea59775daa9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:41.093496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-73476ad1-3267-4376-9167-ea59775daa9c tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.170229 Jun 30 04:21:41.094176 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 378/782] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:40 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:21:41.176818 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-bd02c8ca-d9b8-415b-80ce-8063f1409856 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:41.184954 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-bd02c8ca-d9b8-415b-80ce-8063f1409856 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.188608 Jun 30 04:21:41.185596 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 405/783] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:40 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:41.542517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-4139ad15-1f5e-41df-bf93-697b64413168 req-02762c2e-d120-4f11-b73c-933aa81192fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51354e88-a19f-433f-85b3-126269c921c4", "name": "network-vif-plugged", "status": "completed", "tag": "90e33ddf-37e0-40e5-ac04-e09a2cb58d98"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:41.550943 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4139ad15-1f5e-41df-bf93-697b64413168 req-02762c2e-d120-4f11-b73c-933aa81192fd service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:41.551434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4139ad15-1f5e-41df-bf93-697b64413168 req-02762c2e-d120-4f11-b73c-933aa81192fd service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:41.563659 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-4139ad15-1f5e-41df-bf93-697b64413168 req-02762c2e-d120-4f11-b73c-933aa81192fd service nova] Creating event network-vif-plugged:90e33ddf-37e0-40e5-ac04-e09a2cb58d98 for instance 51354e88-a19f-433f-85b3-126269c921c4 on hv-cinder-84684 Jun 30 04:21:41.568511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-4139ad15-1f5e-41df-bf93-697b64413168 req-02762c2e-d120-4f11-b73c-933aa81192fd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029956 Jun 30 04:21:41.569375 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 379/784] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:41.945209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a194eac6-802e-4075-8909-788eaff7efdd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:41.945888 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a194eac6-802e-4075-8909-788eaff7efdd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:41.952610 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a194eac6-802e-4075-8909-788eaff7efdd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:41.953064 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a194eac6-802e-4075-8909-788eaff7efdd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:41.953824 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a194eac6-802e-4075-8909-788eaff7efdd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:41.954232 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a194eac6-802e-4075-8909-788eaff7efdd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:42.090911 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a194eac6-802e-4075-8909-788eaff7efdd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:42.098561 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a194eac6-802e-4075-8909-788eaff7efdd tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.157419 Jun 30 04:21:42.099141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 406/785] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:41 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:42.112641 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0337380b-d4e4-4cb3-bdc9-33c486192dd5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:42.113682 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0337380b-d4e4-4cb3-bdc9-33c486192dd5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:42.120984 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0337380b-d4e4-4cb3-bdc9-33c486192dd5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:42.121431 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0337380b-d4e4-4cb3-bdc9-33c486192dd5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:42.122191 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0337380b-d4e4-4cb3-bdc9-33c486192dd5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:42.122621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0337380b-d4e4-4cb3-bdc9-33c486192dd5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:42.202130 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d061e650-87c2-407e-a18a-e501c25d1023 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:42.202733 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d061e650-87c2-407e-a18a-e501c25d1023 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:42.209686 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d061e650-87c2-407e-a18a-e501c25d1023 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:42.210204 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d061e650-87c2-407e-a18a-e501c25d1023 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:42.210967 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d061e650-87c2-407e-a18a-e501c25d1023 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:42.211423 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d061e650-87c2-407e-a18a-e501c25d1023 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:42.286080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0337380b-d4e4-4cb3-bdc9-33c486192dd5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:42.297580 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0337380b-d4e4-4cb3-bdc9-33c486192dd5 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.191390 Jun 30 04:21:42.302835 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 380/786] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:42 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:42.371373 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d061e650-87c2-407e-a18a-e501c25d1023 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:42.379270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d061e650-87c2-407e-a18a-e501c25d1023 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.181152 Jun 30 04:21:42.379881 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 407/787] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:42 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:43.119949 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-18accfeb-c0da-4b0d-bdcf-cdb3fb57e0c0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:43.120619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-18accfeb-c0da-4b0d-bdcf-cdb3fb57e0c0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:43.129338 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-18accfeb-c0da-4b0d-bdcf-cdb3fb57e0c0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:43.129891 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-18accfeb-c0da-4b0d-bdcf-cdb3fb57e0c0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:43.130825 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-18accfeb-c0da-4b0d-bdcf-cdb3fb57e0c0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:43.131396 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-18accfeb-c0da-4b0d-bdcf-cdb3fb57e0c0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:43.280258 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-18accfeb-c0da-4b0d-bdcf-cdb3fb57e0c0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:43.287948 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-18accfeb-c0da-4b0d-bdcf-cdb3fb57e0c0 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.174536 Jun 30 04:21:43.288770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 381/788] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:43 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:43.403622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b9025e23-9a3b-407e-8c63-df83ab568d5a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:43.404234 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b9025e23-9a3b-407e-8c63-df83ab568d5a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:43.410301 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9025e23-9a3b-407e-8c63-df83ab568d5a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:43.410750 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9025e23-9a3b-407e-8c63-df83ab568d5a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:43.411608 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9025e23-9a3b-407e-8c63-df83ab568d5a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:43.412037 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9025e23-9a3b-407e-8c63-df83ab568d5a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:43.549223 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b9025e23-9a3b-407e-8c63-df83ab568d5a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:43.558218 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b9025e23-9a3b-407e-8c63-df83ab568d5a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.158976 Jun 30 04:21:43.558799 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 382/789] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:43 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:43.561165 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0894b94a-d43b-4cdc-8668-056011326c04 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:43.561777 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0894b94a-d43b-4cdc-8668-056011326c04 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:43.567911 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0894b94a-d43b-4cdc-8668-056011326c04 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:43.568354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0894b94a-d43b-4cdc-8668-056011326c04 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:43.569111 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0894b94a-d43b-4cdc-8668-056011326c04 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:43.569539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0894b94a-d43b-4cdc-8668-056011326c04 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:43.594780 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-4080ce22-dd2c-4e15-8a80-8b9fc144c567 req-0e655588-6e64-4487-b116-7f8756f44978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "997a86f0-800e-427c-91a4-9c6a7c8f7fff", "name": "network-vif-plugged", "status": "completed", "tag": "231a2e75-10e5-4ba7-b633-e79d395e40f4"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:43.603817 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4080ce22-dd2c-4e15-8a80-8b9fc144c567 req-0e655588-6e64-4487-b116-7f8756f44978 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:43.604263 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4080ce22-dd2c-4e15-8a80-8b9fc144c567 req-0e655588-6e64-4487-b116-7f8756f44978 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:43.615494 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-4080ce22-dd2c-4e15-8a80-8b9fc144c567 req-0e655588-6e64-4487-b116-7f8756f44978 service nova] Creating event network-vif-plugged:231a2e75-10e5-4ba7-b633-e79d395e40f4 for instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff on hv-cinder-84684 Jun 30 04:21:43.620770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-4080ce22-dd2c-4e15-8a80-8b9fc144c567 req-0e655588-6e64-4487-b116-7f8756f44978 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029742 Jun 30 04:21:43.621372 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 383/790] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:21:43.708422 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0894b94a-d43b-4cdc-8668-056011326c04 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:43.716369 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0894b94a-d43b-4cdc-8668-056011326c04 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1521 microversion: 2.1 time: 0.400937 Jun 30 04:21:43.716954 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 408/791] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:43 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:44.306404 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-193c5986-3e28-4af4-adea-b8ebb78bd4a9 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:44.307188 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-193c5986-3e28-4af4-adea-b8ebb78bd4a9 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:44.313579 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-193c5986-3e28-4af4-adea-b8ebb78bd4a9 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:44.314035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-193c5986-3e28-4af4-adea-b8ebb78bd4a9 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:44.314768 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-193c5986-3e28-4af4-adea-b8ebb78bd4a9 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:44.315254 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-193c5986-3e28-4af4-adea-b8ebb78bd4a9 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:44.532794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-193c5986-3e28-4af4-adea-b8ebb78bd4a9 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:44.540455 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-193c5986-3e28-4af4-adea-b8ebb78bd4a9 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.238946 Jun 30 04:21:44.544794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 384/792] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:44 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:44.576070 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-430f97e0-0ccc-4aeb-8844-619186f912b7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:44.576679 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-430f97e0-0ccc-4aeb-8844-619186f912b7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:44.583563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-430f97e0-0ccc-4aeb-8844-619186f912b7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:44.584189 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-430f97e0-0ccc-4aeb-8844-619186f912b7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:44.584962 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-430f97e0-0ccc-4aeb-8844-619186f912b7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:44.585507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-430f97e0-0ccc-4aeb-8844-619186f912b7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:44.733410 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-acf9e174-fafd-4c34-80da-a3f335ee4e7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:44.734020 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-acf9e174-fafd-4c34-80da-a3f335ee4e7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:44.740317 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-acf9e174-fafd-4c34-80da-a3f335ee4e7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:44.740762 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-acf9e174-fafd-4c34-80da-a3f335ee4e7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:44.741511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-acf9e174-fafd-4c34-80da-a3f335ee4e7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:44.742562 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-acf9e174-fafd-4c34-80da-a3f335ee4e7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:44.815426 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-acf9e174-fafd-4c34-80da-a3f335ee4e7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:44.820537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-430f97e0-0ccc-4aeb-8844-619186f912b7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:44.823473 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-acf9e174-fafd-4c34-80da-a3f335ee4e7f tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1479 microversion: 2.1 time: 0.093882 Jun 30 04:21:44.824020 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 385/793] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:44 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1479 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:44.828627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-430f97e0-0ccc-4aeb-8844-619186f912b7 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1574 microversion: 2.1 time: 0.256504 Jun 30 04:21:44.828792 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-8d15d6a6-2b47-47e9-af01-4a47833aabff req-1fc85071-6164-484b-b666-cba8a7a08a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a789ea-78f4-481d-bd9b-45bce25676ad", "name": "network-vif-deleted", "tag": "f7491189-7e96-4247-aee7-3f42f81272cd"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:44.829384 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 409/794] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:44 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1574 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:44.836697 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8d15d6a6-2b47-47e9-af01-4a47833aabff req-1fc85071-6164-484b-b666-cba8a7a08a1e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:44.837126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8d15d6a6-2b47-47e9-af01-4a47833aabff req-1fc85071-6164-484b-b666-cba8a7a08a1e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:44.848790 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-8d15d6a6-2b47-47e9-af01-4a47833aabff req-1fc85071-6164-484b-b666-cba8a7a08a1e service nova] Creating event network-vif-deleted:f7491189-7e96-4247-aee7-3f42f81272cd for instance b9a789ea-78f4-481d-bd9b-45bce25676ad on hv-cinder-84684 Jun 30 04:21:44.853855 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-8d15d6a6-2b47-47e9-af01-4a47833aabff req-1fc85071-6164-484b-b666-cba8a7a08a1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028529 Jun 30 04:21:44.854420 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 386/795] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:45.561502 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1958c925-b41c-45d6-bc47-e7bbe261c87b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:45.562859 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1958c925-b41c-45d6-bc47-e7bbe261c87b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:45.572457 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1958c925-b41c-45d6-bc47-e7bbe261c87b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:45.572897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1958c925-b41c-45d6-bc47-e7bbe261c87b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:45.574167 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1958c925-b41c-45d6-bc47-e7bbe261c87b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:45.574167 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1958c925-b41c-45d6-bc47-e7bbe261c87b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:45.707130 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1958c925-b41c-45d6-bc47-e7bbe261c87b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:45.715312 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1958c925-b41c-45d6-bc47-e7bbe261c87b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1265 microversion: 2.1 time: 0.160314 Jun 30 04:21:45.715881 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 410/796] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:45 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:45.841755 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:45.842323 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:45.845046 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-883f8686-73a0-4536-a3dd-5749f91b4f94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:45.845712 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-883f8686-73a0-4536-a3dd-5749f91b4f94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:45.849180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:45.849622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:45.850391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:45.850870 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:45.852782 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-883f8686-73a0-4536-a3dd-5749f91b4f94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:45.853251 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-883f8686-73a0-4536-a3dd-5749f91b4f94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:45.854092 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-883f8686-73a0-4536-a3dd-5749f91b4f94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:45.854513 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-883f8686-73a0-4536-a3dd-5749f91b4f94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:45.888641 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:45.889119 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:45.889729 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lazy-loading 'fault' on Instance uuid b9a789ea-78f4-481d-bd9b-45bce25676ad {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:21:45.963683 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6854699a1dc475ab11a89bcaf2af85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b53f46d15c4465b9005939114e67a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:45.975525 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-607fa9f9-5b9a-431b-b836-af874d909587 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 200 len: 1311 microversion: 2.1 time: 0.138420 Jun 30 04:21:45.976160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 387/797] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:45 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:46.038006 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-883f8686-73a0-4536-a3dd-5749f91b4f94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:46.045954 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-883f8686-73a0-4536-a3dd-5749f91b4f94 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1561 microversion: 2.1 time: 0.204700 Jun 30 04:21:46.046516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 411/798] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:45 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:46.733724 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9b06332a-e616-4215-ab5c-f355edba9b39 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:46.734522 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9b06332a-e616-4215-ab5c-f355edba9b39 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:46.743423 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b06332a-e616-4215-ab5c-f355edba9b39 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:46.743870 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b06332a-e616-4215-ab5c-f355edba9b39 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:46.744634 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b06332a-e616-4215-ab5c-f355edba9b39 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:46.745068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b06332a-e616-4215-ab5c-f355edba9b39 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:46.897784 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9b06332a-e616-4215-ab5c-f355edba9b39 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:46.906066 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9b06332a-e616-4215-ab5c-f355edba9b39 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1452 microversion: 2.1 time: 0.178395 Jun 30 04:21:46.906630 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 388/799] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:46 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:46.922210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-775377cd-9bef-4bcb-b22f-8a06d908b5ad tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:46.922811 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-775377cd-9bef-4bcb-b22f-8a06d908b5ad tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:46.929740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-775377cd-9bef-4bcb-b22f-8a06d908b5ad tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:46.930180 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-775377cd-9bef-4bcb-b22f-8a06d908b5ad tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:46.930925 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-775377cd-9bef-4bcb-b22f-8a06d908b5ad tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:46.931388 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-775377cd-9bef-4bcb-b22f-8a06d908b5ad tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:46.951266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:46.993447 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-305d1764-e936-4e33-9270-12cb42e0fca9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:46.994061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-305d1764-e936-4e33-9270-12cb42e0fca9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] [instance: b9a789ea-78f4-481d-bd9b-45bce25676ad] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:47.000694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-305d1764-e936-4e33-9270-12cb42e0fca9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:47.001160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-305d1764-e936-4e33-9270-12cb42e0fca9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:47.001909 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-305d1764-e936-4e33-9270-12cb42e0fca9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:47.002340 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-305d1764-e936-4e33-9270-12cb42e0fca9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:47.016580 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-305d1764-e936-4e33-9270-12cb42e0fca9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] HTTP exception thrown: Instance b9a789ea-78f4-481d-bd9b-45bce25676ad could not be found. Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-305d1764-e936-4e33-9270-12cb42e0fca9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Request method failure captured: Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad HTTP/1.1 Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSOgW5TdQdIDnKRvRN6OMIhpIxAn2TKObfMVZ_JlbTYawaWtUqJSBAcUwPpiMbmhabkYxhVFA8mAfsXKkBB-sLhYFC6mMr2p3YJrMJjtEXUPxpHpeI0lkKEnL1xpp2Dw8Df0bDRkrrlKKYAeqTbtfqBunbiYcSLFxb4qb3NxzJ1LYcs Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 74b53f46d15c4465b9005939114e67a3 Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:21:47.018265 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74b53f46d15c4465b9005939114e67a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_74b53f46d15c4465b9005939114e67a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74b53f46d15c4465b9005939114e67a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/74b53f46d15c4465b9005939114e67a3"}]}] Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 74b53f46d15c4465b9005939114e67a3 Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1003299466 Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-ServerRescueNegativeTestJSON-1003299466-project Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: b6854699a1dc475ab11a89bcaf2af85a Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1003299466-project Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance b9a789ea-78f4-481d-bd9b-45bce25676ad could not be found. Jun 30 04:21:47.019671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': 'b9a789ea-78f4-481d-bd9b-45bce25676ad'} Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a789ea-78f4-481d-bd9b-45bce25676ad could not be found. Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:21:47.020435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a789ea-78f4-481d-bd9b-45bce25676ad could not be found. Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a789ea-78f4-481d-bd9b-45bce25676ad could not be found. Jun 30 04:21:47.021761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:21:47.024229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-305d1764-e936-4e33-9270-12cb42e0fca9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] Returning 404 to user: Instance b9a789ea-78f4-481d-bd9b-45bce25676ad could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:21:47.024229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-305d1764-e936-4e33-9270-12cb42e0fca9 tempest-ServerRescueNegativeTestJSON-1003299466 tempest-ServerRescueNegativeTestJSON-1003299466-project] 10.222.0.13 "GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad" status: 404 len: 111 microversion: 2.1 time: 0.030413 Jun 30 04:21:47.024229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 389/800] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:46 2022] GET /compute/v2.1/servers/b9a789ea-78f4-481d-bd9b-45bce25676ad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:21:47.072496 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-775377cd-9bef-4bcb-b22f-8a06d908b5ad tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:47.080113 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-775377cd-9bef-4bcb-b22f-8a06d908b5ad tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1452 microversion: 2.1 time: 0.161751 Jun 30 04:21:47.080770 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 412/801] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:46 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:49.955159 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-5e7d8955-77da-4341-8fc3-b8ff2ffe463a req-b7e07a44-6339-4bbe-92f3-62680d3a33c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "997a86f0-800e-427c-91a4-9c6a7c8f7fff", "tag": "231a2e75-10e5-4ba7-b633-e79d395e40f4"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:49.964630 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-5e7d8955-77da-4341-8fc3-b8ff2ffe463a req-b7e07a44-6339-4bbe-92f3-62680d3a33c0 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:49.965356 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-5e7d8955-77da-4341-8fc3-b8ff2ffe463a req-b7e07a44-6339-4bbe-92f3-62680d3a33c0 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:49.977687 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-5e7d8955-77da-4341-8fc3-b8ff2ffe463a req-b7e07a44-6339-4bbe-92f3-62680d3a33c0 service nova] Creating event network-changed:231a2e75-10e5-4ba7-b633-e79d395e40f4 for instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff on hv-cinder-84684 Jun 30 04:21:49.983194 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-5e7d8955-77da-4341-8fc3-b8ff2ffe463a req-b7e07a44-6339-4bbe-92f3-62680d3a33c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031916 Jun 30 04:21:49.987640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 390/802] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:21:57.306567 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=21 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:57.308290 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:21:57.461142 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-be59ac46-63f6-48db-af58-3891547bc6c6 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'create', calling method: .version_select at 0x7fb480072160>, body: {"keypair": {"name": "tempest-keypair-755890047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxjc9cZHMCHk4sMNxKJCql4ivYYqt4wl260aObdczBDXROMol8JFU/6fQcLV9pwKTTpCQJfuEF/cHyrfQOtyrD+5M6+UCIvKwatqZ0HuOnzjLJ3vlEwPe4iT0m8UQwgZA=="}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:57.477996 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-be59ac46-63f6-48db-af58-3891547bc6c6 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Getting quotas for project cec258de3eea4a12a7bd9b2b9832dce6. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:21:57.482025 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-be59ac46-63f6-48db-af58-3891547bc6c6 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Getting quotas for user a432229e175149b0bc254f19af8007fa and project cec258de3eea4a12a7bd9b2b9832dce6. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:21:57.505614 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-be59ac46-63f6-48db-af58-3891547bc6c6 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.204325 Jun 30 04:21:57.506322 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 413/803] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 30 04:21:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:21:57.827538 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-295b31de-8a11-4974-82cd-eb72dfe8a2be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:57.829210 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-295b31de-8a11-4974-82cd-eb72dfe8a2be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:57.836571 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-295b31de-8a11-4974-82cd-eb72dfe8a2be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:57.837389 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-295b31de-8a11-4974-82cd-eb72dfe8a2be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:57.838420 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-295b31de-8a11-4974-82cd-eb72dfe8a2be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:57.839011 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-295b31de-8a11-4974-82cd-eb72dfe8a2be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:57.872564 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-295b31de-8a11-4974-82cd-eb72dfe8a2be tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050390 Jun 30 04:21:57.876025 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 391/804] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 30 04:21:57 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:21:57.941101 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4c3fe70f-460d-4561-a470-01afc1ac7400 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:57.941601 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4c3fe70f-460d-4561-a470-01afc1ac7400 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:57.948936 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4c3fe70f-460d-4561-a470-01afc1ac7400 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:57.949788 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4c3fe70f-460d-4561-a470-01afc1ac7400 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:57.950741 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4c3fe70f-460d-4561-a470-01afc1ac7400 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:57.951427 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4c3fe70f-460d-4561-a470-01afc1ac7400 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:57.980128 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4c3fe70f-460d-4561-a470-01afc1ac7400 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:21:58.081935 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4c3fe70f-460d-4561-a470-01afc1ac7400 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 204 len: 0 microversion: 2.20 time: 0.144412 Jun 30 04:21:58.083382 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 414/805] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 30 04:21:57 2022] DELETE /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 04:21:58.092738 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5d3435ed-22c8-49dc-87cb-c27b49294ce4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:58.094481 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5d3435ed-22c8-49dc-87cb-c27b49294ce4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:58.101330 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5d3435ed-22c8-49dc-87cb-c27b49294ce4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:58.101781 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5d3435ed-22c8-49dc-87cb-c27b49294ce4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:58.102655 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5d3435ed-22c8-49dc-87cb-c27b49294ce4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:58.103486 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5d3435ed-22c8-49dc-87cb-c27b49294ce4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:58.316277 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5d3435ed-22c8-49dc-87cb-c27b49294ce4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:58.326595 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5d3435ed-22c8-49dc-87cb-c27b49294ce4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:58.328241 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5d3435ed-22c8-49dc-87cb-c27b49294ce4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:58.329402 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5d3435ed-22c8-49dc-87cb-c27b49294ce4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.241310 Jun 30 04:21:58.329965 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 392/806] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:58 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:21:58.959125 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2057392735", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ae8070a-7682-4fda-9ac2-70bc78e189c1"}], "security_groups": [{"name": "tempest-securitygroup--1236630855"}], "key_name": "tempest-keypair-755890047", "user_data": "}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:21:59.075603 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] validate_networks() for [('6ae8070a-7682-4fda-9ac2-70bc78e189c1', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:21:59.348219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8250ffb0-daa6-4fef-a1a9-960d8e99b805 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:59.348842 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8250ffb0-daa6-4fef-a1a9-960d8e99b805 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:59.356188 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8250ffb0-daa6-4fef-a1a9-960d8e99b805 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:59.356861 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8250ffb0-daa6-4fef-a1a9-960d8e99b805 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:59.357779 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8250ffb0-daa6-4fef-a1a9-960d8e99b805 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:59.358359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8250ffb0-daa6-4fef-a1a9-960d8e99b805 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:59.594957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8250ffb0-daa6-4fef-a1a9-960d8e99b805 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:59.604014 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8250ffb0-daa6-4fef-a1a9-960d8e99b805 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:59.605530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8250ffb0-daa6-4fef-a1a9-960d8e99b805 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:59.606712 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8250ffb0-daa6-4fef-a1a9-960d8e99b805 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1724 microversion: 2.20 time: 0.262572 Jun 30 04:21:59.607621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 393/807] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:21:59 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 04:21:59.620446 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:21:59.620865 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:21:59.621329 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:21:59.621744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:21:59.622137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:21:59.631558 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:59.632041 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:59.632835 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:21:59.633270 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:21:59.650421 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Getting quotas for project cec258de3eea4a12a7bd9b2b9832dce6. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:21:59.654926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Getting quotas for user a432229e175149b0bc254f19af8007fa and project cec258de3eea4a12a7bd9b2b9832dce6. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:21:59.666778 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:21:59.669234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:21:59.725427 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4d2f0bc5-1103-4951-a4ba-eee98a2e5be9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.771026 Jun 30 04:21:59.726795 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 415/808] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:21:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:21:59.737135 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8ca33667-bc2c-431e-94ce-f115b3fd40de tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:21:59.738030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8ca33667-bc2c-431e-94ce-f115b3fd40de tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:21:59.824717 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8ca33667-bc2c-431e-94ce-f115b3fd40de tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:21:59.835055 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8ca33667-bc2c-431e-94ce-f115b3fd40de tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1237 microversion: 2.1 time: 0.101833 Jun 30 04:21:59.835856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 394/809] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:21:59 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:22:00.626420 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1f3161f8-a18f-4ee9-8d7d-ce5f18c535d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:00.628216 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1f3161f8-a18f-4ee9-8d7d-ce5f18c535d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:00.636226 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1f3161f8-a18f-4ee9-8d7d-ce5f18c535d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:00.637038 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1f3161f8-a18f-4ee9-8d7d-ce5f18c535d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:00.638020 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1f3161f8-a18f-4ee9-8d7d-ce5f18c535d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:00.638648 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1f3161f8-a18f-4ee9-8d7d-ce5f18c535d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:00.747822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1f3161f8-a18f-4ee9-8d7d-ce5f18c535d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:00.768042 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-22c4f626-a840-467c-9041-14c6fdf95fc6 req-2818f71a-86ef-4357-957e-9ff2ef3cd3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a344d61b-2dbc-49a8-b5c1-4d5619af3e77", "name": "network-vif-deleted", "tag": "14e3c353-ee55-4eee-8bdc-9d20ccd23a9e"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:22:00.768916 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1f3161f8-a18f-4ee9-8d7d-ce5f18c535d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:00.769976 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-1f3161f8-a18f-4ee9-8d7d-ce5f18c535d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e3bc7e015f5419aa956568707764f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71588f8a5fc34919a77f28b6a8c8db0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:00.771482 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1f3161f8-a18f-4ee9-8d7d-ce5f18c535d9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 200 len: 1656 microversion: 2.20 time: 0.150104 Jun 30 04:22:00.773071 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 416/810] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:22:00 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 04:22:00.787281 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-22c4f626-a840-467c-9041-14c6fdf95fc6 req-2818f71a-86ef-4357-957e-9ff2ef3cd3ee service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:00.789364 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-22c4f626-a840-467c-9041-14c6fdf95fc6 req-2818f71a-86ef-4357-957e-9ff2ef3cd3ee service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:00.804459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-22c4f626-a840-467c-9041-14c6fdf95fc6 req-2818f71a-86ef-4357-957e-9ff2ef3cd3ee service nova] Creating event network-vif-deleted:14e3c353-ee55-4eee-8bdc-9d20ccd23a9e for instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 on hv-cinder-84684 Jun 30 04:22:00.811724 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-22c4f626-a840-467c-9041-14c6fdf95fc6 req-2818f71a-86ef-4357-957e-9ff2ef3cd3ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054946 Jun 30 04:22:00.812481 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 395/811] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:22:00.854722 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-42bfb948-3334-418b-8c0f-aad38a7bb81d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:00.855430 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-42bfb948-3334-418b-8c0f-aad38a7bb81d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:00.864602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-42bfb948-3334-418b-8c0f-aad38a7bb81d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:00.865420 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-42bfb948-3334-418b-8c0f-aad38a7bb81d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:00.866412 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-42bfb948-3334-418b-8c0f-aad38a7bb81d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:00.867059 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-42bfb948-3334-418b-8c0f-aad38a7bb81d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:00.992520 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-42bfb948-3334-418b-8c0f-aad38a7bb81d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:01.014699 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-42bfb948-3334-418b-8c0f-aad38a7bb81d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1289 microversion: 2.1 time: 0.165515 Jun 30 04:22:01.031702 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 417/812] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:22:00 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1289 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:22:01.793763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-14acb226-1570-44e5-8f7b-163eb666cb84 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:01.795196 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-14acb226-1570-44e5-8f7b-163eb666cb84 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:01.802735 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14acb226-1570-44e5-8f7b-163eb666cb84 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:01.803520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14acb226-1570-44e5-8f7b-163eb666cb84 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:01.804858 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14acb226-1570-44e5-8f7b-163eb666cb84 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:01.805622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-14acb226-1570-44e5-8f7b-163eb666cb84 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:01.828690 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-14acb226-1570-44e5-8f7b-163eb666cb84 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] HTTP exception thrown: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-14acb226-1570-44e5-8f7b-163eb666cb84 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Request method failure captured: Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 HTTP/1.1 Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSNQsk-6X430AgxlsYMK_xfgXD3QIR_YcGcLOc1F0bJAYe-GGII0D15StDWufPR7AXMaOrCfvhzCpOLegukGTCu8dmpB09FRdEWy4XTxeXBWhLqEf7sQpqkN4vCCqYZJS4WsUsAIpzEKwKdkp7_EPQmRC9TM9ieBWyB8d8z61ssPEl8 Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:22:01.830395 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71588f8a5fc34919a77f28b6a8c8db0e"}]}] Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: 8e3bc7e015f5419aa956568707764f67 Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:01.832739 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': 'a344d61b-2dbc-49a8-b5c1-4d5619af3e77'} Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:22:01.833898 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:01.835379 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:01.838163 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-14acb226-1570-44e5-8f7b-163eb666cb84 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Returning 404 to user: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:22:01.839548 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-14acb226-1570-44e5-8f7b-163eb666cb84 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 404 len: 111 microversion: 2.20 time: 0.051996 Jun 30 04:22:01.844113 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 396/813] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:22:01 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 04:22:01.850455 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9f064dd9-7d5c-44ea-a31a-4368601211d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '.version_select at 0x7fb480128430>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:01.870218 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9f064dd9-7d5c-44ea-a31a-4368601211d4 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988349919" status: 204 len: 0 microversion: 2.20 time: 0.025084 Jun 30 04:22:01.870810 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 418/814] 10.222.0.13 () {60 vars in 1261 bytes} [Thu Jun 30 04:22:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1988349919 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 04:22:02.037471 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a6054696-73de-425f-ba04-d887439cc816 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:02.038377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a6054696-73de-425f-ba04-d887439cc816 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:02.046043 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6054696-73de-425f-ba04-d887439cc816 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:02.047140 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6054696-73de-425f-ba04-d887439cc816 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:02.048177 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6054696-73de-425f-ba04-d887439cc816 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:02.048826 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6054696-73de-425f-ba04-d887439cc816 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:02.052911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:22:02.751672 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a6054696-73de-425f-ba04-d887439cc816 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:02.759679 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a6054696-73de-425f-ba04-d887439cc816 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1363 microversion: 2.1 time: 0.726319 Jun 30 04:22:02.760269 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 397/815] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:22:02 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1363 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:22:03.329831 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-11c5cc75-bf91-4ee5-8563-9f720502d045 req-f2d42f8c-a4e6-43ef-adf3-a92cdbe87f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5", "tag": "92d5d28e-901e-4fdd-a753-3d722a745dcb"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:22:03.348220 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-11c5cc75-bf91-4ee5-8563-9f720502d045 req-f2d42f8c-a4e6-43ef-adf3-a92cdbe87f0d service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:03.348680 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-11c5cc75-bf91-4ee5-8563-9f720502d045 req-f2d42f8c-a4e6-43ef-adf3-a92cdbe87f0d service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:03.365263 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-11c5cc75-bf91-4ee5-8563-9f720502d045 req-f2d42f8c-a4e6-43ef-adf3-a92cdbe87f0d service nova] Creating event network-changed:92d5d28e-901e-4fdd-a753-3d722a745dcb for instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 on hv-cinder-84684 Jun 30 04:22:03.370630 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-11c5cc75-bf91-4ee5-8563-9f720502d045 req-f2d42f8c-a4e6-43ef-adf3-a92cdbe87f0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044234 Jun 30 04:22:03.371661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 419/816] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:22:03.778310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-40dabc72-8a86-4afa-81d0-52b7652c62fa tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:03.778937 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-40dabc72-8a86-4afa-81d0-52b7652c62fa tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:03.786083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40dabc72-8a86-4afa-81d0-52b7652c62fa tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:03.786525 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40dabc72-8a86-4afa-81d0-52b7652c62fa tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:03.787554 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40dabc72-8a86-4afa-81d0-52b7652c62fa tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:03.787996 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40dabc72-8a86-4afa-81d0-52b7652c62fa tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:03.945010 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-40dabc72-8a86-4afa-81d0-52b7652c62fa tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:03.956270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-40dabc72-8a86-4afa-81d0-52b7652c62fa tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1363 microversion: 2.1 time: 0.182616 Jun 30 04:22:03.957089 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 398/817] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:22:03 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:22:04.441131 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-47041238-8cc4-4786-8411-985eaf3bcf92 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:04.441872 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-47041238-8cc4-4786-8411-985eaf3bcf92 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:04.448721 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-47041238-8cc4-4786-8411-985eaf3bcf92 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:04.449166 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-47041238-8cc4-4786-8411-985eaf3bcf92 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:04.449931 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-47041238-8cc4-4786-8411-985eaf3bcf92 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:04.450364 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-47041238-8cc4-4786-8411-985eaf3bcf92 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:04.464057 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-47041238-8cc4-4786-8411-985eaf3bcf92 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] HTTP exception thrown: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-47041238-8cc4-4786-8411-985eaf3bcf92 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Request method failure captured: Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: DELETE /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 HTTP/1.1 Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSNQsk-6X430AgxlsYMK_xfgXD3QIR_YcGcLOc1F0bJAYe-GGII0D15StDWufPR7AXMaOrCfvhzCpOLegukGTCu8dmpB09FRdEWy4XTxeXBWhLqEf7sQpqkN4vCCqYZJS4WsUsAIpzEKwKdkp7_EPQmRC9TM9ieBWyB8d8z61ssPEl8 Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:22:04.465720 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71588f8a5fc34919a77f28b6a8c8db0e"}]}] Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: 8e3bc7e015f5419aa956568707764f67 Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:04.467273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': 'a344d61b-2dbc-49a8-b5c1-4d5619af3e77'} Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:22:04.468141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:04.469585 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:04.471193 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-47041238-8cc4-4786-8411-985eaf3bcf92 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Returning 404 to user: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:22:04.471193 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-47041238-8cc4-4786-8411-985eaf3bcf92 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 404 len: 111 microversion: 2.20 time: 0.030762 Jun 30 04:22:04.471193 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 420/818] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 30 04:22:04 2022] DELETE /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 04:22:04.475721 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6685213b-58da-407a-8318-f4a741207906 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:04.476333 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6685213b-58da-407a-8318-f4a741207906 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: a344d61b-2dbc-49a8-b5c1-4d5619af3e77] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:04.482545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6685213b-58da-407a-8318-f4a741207906 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:04.482994 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6685213b-58da-407a-8318-f4a741207906 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:04.483783 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6685213b-58da-407a-8318-f4a741207906 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:04.484213 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6685213b-58da-407a-8318-f4a741207906 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:04.497573 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-6685213b-58da-407a-8318-f4a741207906 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] HTTP exception thrown: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6685213b-58da-407a-8318-f4a741207906 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Request method failure captured: Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 HTTP/1.1 Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSNQsk-6X430AgxlsYMK_xfgXD3QIR_YcGcLOc1F0bJAYe-GGII0D15StDWufPR7AXMaOrCfvhzCpOLegukGTCu8dmpB09FRdEWy4XTxeXBWhLqEf7sQpqkN4vCCqYZJS4WsUsAIpzEKwKdkp7_EPQmRC9TM9ieBWyB8d8z61ssPEl8 Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:22:04.499126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71588f8a5fc34919a77f28b6a8c8db0e"}]}] Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: 8e3bc7e015f5419aa956568707764f67 Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:04.500699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': 'a344d61b-2dbc-49a8-b5c1-4d5619af3e77'} Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:22:04.501711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. Jun 30 04:22:04.503148 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:04.504569 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6685213b-58da-407a-8318-f4a741207906 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Returning 404 to user: Instance a344d61b-2dbc-49a8-b5c1-4d5619af3e77 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:22:04.504569 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6685213b-58da-407a-8318-f4a741207906 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77" status: 404 len: 111 microversion: 2.20 time: 0.028672 Jun 30 04:22:04.504569 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 399/819] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:22:04 2022] GET /compute/v2.1/servers/a344d61b-2dbc-49a8-b5c1-4d5619af3e77 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 30 04:22:04.974618 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-dd3a2f77-865d-4edc-be91-ed2f32264f5b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:04.975655 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-dd3a2f77-865d-4edc-be91-ed2f32264f5b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:04.982648 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dd3a2f77-865d-4edc-be91-ed2f32264f5b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:04.983117 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dd3a2f77-865d-4edc-be91-ed2f32264f5b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:04.983894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dd3a2f77-865d-4edc-be91-ed2f32264f5b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:04.984385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dd3a2f77-865d-4edc-be91-ed2f32264f5b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:05.213820 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-dd3a2f77-865d-4edc-be91-ed2f32264f5b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:05.222366 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-dd3a2f77-865d-4edc-be91-ed2f32264f5b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1363 microversion: 2.1 time: 0.251809 Jun 30 04:22:05.223508 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 421/820] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:22:04 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:22:05.647321 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f8e890bb-4fe8-4b13-a6b4-3d649617a2ae tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:05.647861 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f8e890bb-4fe8-4b13-a6b4-3d649617a2ae tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:05.657954 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8e890bb-4fe8-4b13-a6b4-3d649617a2ae tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:05.658447 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8e890bb-4fe8-4b13-a6b4-3d649617a2ae tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:05.659653 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8e890bb-4fe8-4b13-a6b4-3d649617a2ae tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:05.660248 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8e890bb-4fe8-4b13-a6b4-3d649617a2ae tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:05.675766 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-f8e890bb-4fe8-4b13-a6b4-3d649617a2ae tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] HTTP exception thrown: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f8e890bb-4fe8-4b13-a6b4-3d649617a2ae tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Request method failure captured: Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce HTTP/1.1 Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSNQsk-6X430AgxlsYMK_xfgXD3QIR_YcGcLOc1F0bJAYe-GGII0D15StDWufPR7AXMaOrCfvhzCpOLegukGTCu8dmpB09FRdEWy4XTxeXBWhLqEf7sQpqkN4vCCqYZJS4WsUsAIpzEKwKdkp7_EPQmRC9TM9ieBWyB8d8z61ssPEl8 Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:22:05.677380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71588f8a5fc34919a77f28b6a8c8db0e"}]}] Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: 8e3bc7e015f5419aa956568707764f67 Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:22:05.679021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '2d3f3442-a00e-47ee-b0df-f099086628ce'} Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:22:05.679906 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:22:05.682084 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:22:05.683568 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f8e890bb-4fe8-4b13-a6b4-3d649617a2ae tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Returning 404 to user: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:22:05.683568 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f8e890bb-4fe8-4b13-a6b4-3d649617a2ae tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 404 len: 111 microversion: 2.20 time: 0.037835 Jun 30 04:22:05.683568 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 400/821] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 30 04:22:05 2022] DELETE /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 04:22:05.687739 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-653d2220-d7ca-459a-a1b7-30b33553d1c9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:05.688323 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-653d2220-d7ca-459a-a1b7-30b33553d1c9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] [instance: 2d3f3442-a00e-47ee-b0df-f099086628ce] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:05.695186 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-653d2220-d7ca-459a-a1b7-30b33553d1c9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:05.695628 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-653d2220-d7ca-459a-a1b7-30b33553d1c9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:05.696757 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-653d2220-d7ca-459a-a1b7-30b33553d1c9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:05.697198 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-653d2220-d7ca-459a-a1b7-30b33553d1c9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:05.711323 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-653d2220-d7ca-459a-a1b7-30b33553d1c9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] HTTP exception thrown: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-653d2220-d7ca-459a-a1b7-30b33553d1c9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Request method failure captured: Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce HTTP/1.1 Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSNQsk-6X430AgxlsYMK_xfgXD3QIR_YcGcLOc1F0bJAYe-GGII0D15StDWufPR7AXMaOrCfvhzCpOLegukGTCu8dmpB09FRdEWy4XTxeXBWhLqEf7sQpqkN4vCCqYZJS4WsUsAIpzEKwKdkp7_EPQmRC9TM9ieBWyB8d8z61ssPEl8 Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:22:05.713210 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/71588f8a5fc34919a77f28b6a8c8db0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/71588f8a5fc34919a77f28b6a8c8db0e"}]}] Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 71588f8a5fc34919a77f28b6a8c8db0e Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1330718838 Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: 8e3bc7e015f5419aa956568707764f67 Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1330718838-project Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:22:05.714904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '2d3f3442-a00e-47ee-b0df-f099086628ce'} Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:22:05.715826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. Jun 30 04:22:05.717242 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:05.718478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-653d2220-d7ca-459a-a1b7-30b33553d1c9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] Returning 404 to user: Instance 2d3f3442-a00e-47ee-b0df-f099086628ce could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:22:05.718478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-653d2220-d7ca-459a-a1b7-30b33553d1c9 tempest-AttachVolumeShelveTestJSON-1330718838 tempest-AttachVolumeShelveTestJSON-1330718838-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce" status: 404 len: 111 microversion: 2.20 time: 0.030791 Jun 30 04:22:05.718478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 422/822] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 30 04:22:05 2022] GET /compute/v2.1/servers/2d3f3442-a00e-47ee-b0df-f099086628ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 04:22:06.240614 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3a39cb57-ff7c-4d5b-b139-d213c90c5792 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:06.241229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3a39cb57-ff7c-4d5b-b139-d213c90c5792 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:06.247706 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3a39cb57-ff7c-4d5b-b139-d213c90c5792 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:06.248161 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3a39cb57-ff7c-4d5b-b139-d213c90c5792 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:06.248925 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3a39cb57-ff7c-4d5b-b139-d213c90c5792 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:06.249361 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3a39cb57-ff7c-4d5b-b139-d213c90c5792 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:06.494714 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3a39cb57-ff7c-4d5b-b139-d213c90c5792 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:06.503043 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3a39cb57-ff7c-4d5b-b139-d213c90c5792 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1363 microversion: 2.1 time: 0.266572 Jun 30 04:22:06.503640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 401/823] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:22:06 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:22:07.419331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-506c442c-2804-400a-bc85-cc470aab208b req-a55bec03-e0da-4e99-90aa-aeddbddde25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5", "name": "network-vif-plugged", "status": "completed", "tag": "92d5d28e-901e-4fdd-a753-3d722a745dcb"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:22:07.429006 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-506c442c-2804-400a-bc85-cc470aab208b req-a55bec03-e0da-4e99-90aa-aeddbddde25c service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:07.429565 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-506c442c-2804-400a-bc85-cc470aab208b req-a55bec03-e0da-4e99-90aa-aeddbddde25c service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:07.442347 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-506c442c-2804-400a-bc85-cc470aab208b req-a55bec03-e0da-4e99-90aa-aeddbddde25c service nova] Creating event network-vif-plugged:92d5d28e-901e-4fdd-a753-3d722a745dcb for instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 on hv-cinder-84684 Jun 30 04:22:07.448117 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-506c442c-2804-400a-bc85-cc470aab208b req-a55bec03-e0da-4e99-90aa-aeddbddde25c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032353 Jun 30 04:22:07.449179 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 423/824] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:22:07.520607 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-24958cb2-32f1-43d1-907d-01c9ca7bc5cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:07.521205 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-24958cb2-32f1-43d1-907d-01c9ca7bc5cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:07.528912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24958cb2-32f1-43d1-907d-01c9ca7bc5cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:07.529683 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24958cb2-32f1-43d1-907d-01c9ca7bc5cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:07.530569 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24958cb2-32f1-43d1-907d-01c9ca7bc5cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:07.531196 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24958cb2-32f1-43d1-907d-01c9ca7bc5cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:07.743043 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-24958cb2-32f1-43d1-907d-01c9ca7bc5cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:07.751580 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-24958cb2-32f1-43d1-907d-01c9ca7bc5cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1363 microversion: 2.1 time: 0.234607 Jun 30 04:22:07.753042 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 402/825] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:22:07 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:22:08.770313 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-648dfad2-b9ae-4f09-ba5e-48cc9786f13e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:08.771000 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-648dfad2-b9ae-4f09-ba5e-48cc9786f13e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:08.782019 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-648dfad2-b9ae-4f09-ba5e-48cc9786f13e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:08.782468 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-648dfad2-b9ae-4f09-ba5e-48cc9786f13e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:08.783277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-648dfad2-b9ae-4f09-ba5e-48cc9786f13e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:08.783715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-648dfad2-b9ae-4f09-ba5e-48cc9786f13e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:08.927207 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-648dfad2-b9ae-4f09-ba5e-48cc9786f13e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:08.937618 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-648dfad2-b9ae-4f09-ba5e-48cc9786f13e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1363 microversion: 2.1 time: 0.171654 Jun 30 04:22:08.938274 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 424/826] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:22:08 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:22:09.954881 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ab9d7c85-617a-4ed7-b775-1c4b2c1269df tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:09.955535 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ab9d7c85-617a-4ed7-b775-1c4b2c1269df tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:09.958033 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:22:09.963759 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab9d7c85-617a-4ed7-b775-1c4b2c1269df tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:09.964190 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab9d7c85-617a-4ed7-b775-1c4b2c1269df tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:09.964980 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab9d7c85-617a-4ed7-b775-1c4b2c1269df tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:09.965416 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab9d7c85-617a-4ed7-b775-1c4b2c1269df tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:10.110913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ab9d7c85-617a-4ed7-b775-1c4b2c1269df tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:22:10.120078 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ab9d7c85-617a-4ed7-b775-1c4b2c1269df tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1549 microversion: 2.1 time: 0.169038 Jun 30 04:22:10.120737 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 403/827] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:22:09 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:22:10.137203 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d11eac4d-9f7a-4a36-be62-2e159f961de1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:10.137703 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d11eac4d-9f7a-4a36-be62-2e159f961de1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:10.140743 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:22:10.141524 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=10 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:22:10.147190 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d11eac4d-9f7a-4a36-be62-2e159f961de1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:10.147657 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d11eac4d-9f7a-4a36-be62-2e159f961de1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:10.148366 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d11eac4d-9f7a-4a36-be62-2e159f961de1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:10.148790 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d11eac4d-9f7a-4a36-be62-2e159f961de1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:10.232028 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d11eac4d-9f7a-4a36-be62-2e159f961de1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099410 Jun 30 04:22:10.232817 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 425/828] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 30 04:22:10 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:22:10.420642 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6e26a664-cc17-4417-938d-9fa2f434e02c tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] Action: 'create', calling method: .version_select at 0x7fb480080160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-618224492", "metadata": {"Type": "work"}}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:22:10.734046 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6e26a664-cc17-4417-938d-9fa2f434e02c tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.432546 Jun 30 04:22:10.734840 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 404/829] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 30 04:22:10 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 434 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 04:22:10.746342 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9a27e4de-327f-4972-873b-5f7623773c33 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] Calling method '.version_select at 0x7fb480128670>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:10.807418 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9a27e4de-327f-4972-873b-5f7623773c33 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169" status: 200 len: 352 microversion: 2.1 time: 0.065322 Jun 30 04:22:10.808139 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 426/830] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:22:10 2022] GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:22:11.210947 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-380d852d-aa36-43e1-9610-78577ad92b5d req-8d0c44d2-a1d7-408a-a234-e07cc78bb113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5", "tag": "92d5d28e-901e-4fdd-a753-3d722a745dcb"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:22:11.215026 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:22:11.222123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-380d852d-aa36-43e1-9610-78577ad92b5d req-8d0c44d2-a1d7-408a-a234-e07cc78bb113 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:11.222542 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-380d852d-aa36-43e1-9610-78577ad92b5d req-8d0c44d2-a1d7-408a-a234-e07cc78bb113 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:11.234608 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-380d852d-aa36-43e1-9610-78577ad92b5d req-8d0c44d2-a1d7-408a-a234-e07cc78bb113 service nova] Creating event network-changed:92d5d28e-901e-4fdd-a753-3d722a745dcb for instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 on hv-cinder-84684 Jun 30 04:22:11.239620 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-380d852d-aa36-43e1-9610-78577ad92b5d req-8d0c44d2-a1d7-408a-a234-e07cc78bb113 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032945 Jun 30 04:22:11.240209 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 405/831] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:22:11.820653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9c7f95a6-d2ba-459a-b160-75105698fa60 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] Calling method '.version_select at 0x7fb4800c2ee0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:11.869160 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9c7f95a6-d2ba-459a-b160-75105698fa60 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169" status: 200 len: 353 microversion: 2.1 time: 0.052917 Jun 30 04:22:11.870004 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 427/832] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:22:11 2022] GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:22:11.881376 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-403a747e-a25b-4a14-8dca-faa0226edc35 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] Calling method '.version_select at 0x7fb4800538b0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:11.930247 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-403a747e-a25b-4a14-8dca-faa0226edc35 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169" status: 200 len: 353 microversion: 2.1 time: 0.053055 Jun 30 04:22:11.931068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 406/833] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:22:11 2022] GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:22:11.947423 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-26497cea-26c9-4d54-a01e-b95553b555a4 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] Calling method '.version_select at 0x7fb4800b3e50>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:12.169638 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-26497cea-26c9-4d54-a01e-b95553b555a4 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169" status: 202 len: 0 microversion: 2.1 time: 0.226129 Jun 30 04:22:12.170220 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 428/834] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 30 04:22:11 2022] DELETE /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:22:12.178797 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-95fc6217-85ed-4a06-9252-62aecb263dfa tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] Calling method '.version_select at 0x7fb47b748280>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:12.228109 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-95fc6217-85ed-4a06-9252-62aecb263dfa tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169" status: 200 len: 352 microversion: 2.1 time: 0.053220 Jun 30 04:22:12.228756 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 407/835] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:22:12 2022] GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:22:13.241707 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0b4ea09f-bfd9-4a0c-92cf-564e0f1b8076 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] Calling method '.version_select at 0x7fb480093ee0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:13.270731 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-0b4ea09f-bfd9-4a0c-92cf-564e0f1b8076 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] HTTP exception thrown: Volume ff13340b-37e0-4e7f-86d5-48ff3d175169 could not be found. Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0b4ea09f-bfd9-4a0c-92cf-564e0f1b8076 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] Request method failure captured: Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169 HTTP/1.1 Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSTy9r7VgtStPehiKNVrHdT-lC489it76VpIfsEi9qkq0a7ROQvm2cIHmmKk6dEuJZBeOEMNWgpCs7ApvX-zvgcGCo7jBuIIdR4GH7Gc0d98K3B_AFBdSd78u2ye33KpiFw_6m4sVqgJ3pB9MGisX4ewLbruWmvaav5o8hpkpMABAJw Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: f9005946803a45dba07c41408684dd7a Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-VolumesGetTestJSON-1175934181 Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:22:13.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9005946803a45dba07c41408684dd7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9005946803a45dba07c41408684dd7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9005946803a45dba07c41408684dd7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9005946803a45dba07c41408684dd7a"}]}] Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-VolumesGetTestJSON-1175934181 Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: f9005946803a45dba07c41408684dd7a Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-VolumesGetTestJSON-1175934181 Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-VolumesGetTestJSON-1175934181-project Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: d54caea77ad846689e836cca3a33a754 Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-VolumesGetTestJSON-1175934181-project Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Volume ff13340b-37e0-4e7f-86d5-48ff3d175169 could not be found. Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': 'ff13340b-37e0-4e7f-86d5-48ff3d175169'} Jun 30 04:22:13.274465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff13340b-37e0-4e7f-86d5-48ff3d175169 could not be found. (HTTP 404) (Request-ID: req-84c921f0-6f3b-4662-9299-e46efe1b41a6) Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:13.275849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 04:22:13.277199 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff13340b-37e0-4e7f-86d5-48ff3d175169 could not be found. Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 04:22:13.278444 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff13340b-37e0-4e7f-86d5-48ff3d175169 could not be found. Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff13340b-37e0-4e7f-86d5-48ff3d175169 could not be found. Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0b4ea09f-bfd9-4a0c-92cf-564e0f1b8076 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] Returning 404 to user: Volume ff13340b-37e0-4e7f-86d5-48ff3d175169 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0b4ea09f-bfd9-4a0c-92cf-564e0f1b8076 tempest-VolumesGetTestJSON-1175934181 tempest-VolumesGetTestJSON-1175934181-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169" status: 404 len: 109 microversion: 2.1 time: 0.036994 Jun 30 04:22:13.279897 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 429/836] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 30 04:22:13 2022] GET /compute/v2.1/os-volumes/ff13340b-37e0-4e7f-86d5-48ff3d175169 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:22:55.932562 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=35 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:22:55.933775 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:22:55.937306 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6490cdf3-410d-4a26-83fb-87109aa2b42b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:22:55.937885 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6490cdf3-410d-4a26-83fb-87109aa2b42b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:55.945534 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6490cdf3-410d-4a26-83fb-87109aa2b42b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:55.945977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6490cdf3-410d-4a26-83fb-87109aa2b42b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:55.946728 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6490cdf3-410d-4a26-83fb-87109aa2b42b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:55.947182 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6490cdf3-410d-4a26-83fb-87109aa2b42b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:55.970331 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6490cdf3-410d-4a26-83fb-87109aa2b42b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/ips" status: 200 len: 145 microversion: 2.1 time: 0.039452 Jun 30 04:22:55.970929 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 408/837] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 30 04:22:55 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:22:58.054188 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:22:58.055070 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:22:58.059337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5dcacfb1-a27b-43fe-91ab-62143b802115 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1157ef30-bf14-4d51-805f-01a82e80b631"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:22:58.061045 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5dcacfb1-a27b-43fe-91ab-62143b802115 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:22:58.068886 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5dcacfb1-a27b-43fe-91ab-62143b802115 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:58.069329 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5dcacfb1-a27b-43fe-91ab-62143b802115 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:58.070089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5dcacfb1-a27b-43fe-91ab-62143b802115 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:22:58.070516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5dcacfb1-a27b-43fe-91ab-62143b802115 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:22:58.329682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5dcacfb1-a27b-43fe-91ab-62143b802115 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276703 Jun 30 04:22:58.330317 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 430/838] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:22:58 2022] POST /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:23:05.027691 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-79c0f5a1-fbd5-4f60-b999-fe3240b36e54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:23:05.034340 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-79c0f5a1-fbd5-4f60-b999-fe3240b36e54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:05.034792 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-79c0f5a1-fbd5-4f60-b999-fe3240b36e54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:05.093543 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-79c0f5a1-fbd5-4f60-b999-fe3240b36e54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Going to try to stop instance {{(pid=118187) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 04:23:05.152500 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-79c0f5a1-fbd5-4f60-b999-fe3240b36e54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/action" status: 202 len: 0 microversion: 2.1 time: 0.128946 Jun 30 04:23:05.153108 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 409/839] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:23:05 2022] POST /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:23:05.164653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-2e10c4ce-f581-45ff-815e-2a4f1850a02f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:05.165434 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-2e10c4ce-f581-45ff-815e-2a4f1850a02f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:05.172458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2e10c4ce-f581-45ff-815e-2a4f1850a02f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:05.172885 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2e10c4ce-f581-45ff-815e-2a4f1850a02f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:05.173657 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2e10c4ce-f581-45ff-815e-2a4f1850a02f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:05.174095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-2e10c4ce-f581-45ff-815e-2a4f1850a02f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:05.314938 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-2e10c4ce-f581-45ff-815e-2a4f1850a02f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:05.322995 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-2e10c4ce-f581-45ff-815e-2a4f1850a02f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.163086 Jun 30 04:23:05.323619 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 431/840] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:05 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:06.344772 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f514d294-09a2-4cfd-909d-530a42282f27 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:06.345919 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f514d294-09a2-4cfd-909d-530a42282f27 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:06.357496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f514d294-09a2-4cfd-909d-530a42282f27 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:06.358317 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f514d294-09a2-4cfd-909d-530a42282f27 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:06.359136 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f514d294-09a2-4cfd-909d-530a42282f27 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:06.359593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f514d294-09a2-4cfd-909d-530a42282f27 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:06.494973 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f514d294-09a2-4cfd-909d-530a42282f27 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:06.507635 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f514d294-09a2-4cfd-909d-530a42282f27 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.169793 Jun 30 04:23:06.508443 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 410/841] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:06 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:07.528348 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-617d9a62-9e29-4ae7-818a-688e25359c99 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:07.528810 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-617d9a62-9e29-4ae7-818a-688e25359c99 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:07.535979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-617d9a62-9e29-4ae7-818a-688e25359c99 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:07.536500 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-617d9a62-9e29-4ae7-818a-688e25359c99 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:07.537304 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-617d9a62-9e29-4ae7-818a-688e25359c99 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:07.537916 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-617d9a62-9e29-4ae7-818a-688e25359c99 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:07.672838 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-617d9a62-9e29-4ae7-818a-688e25359c99 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:07.681788 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-617d9a62-9e29-4ae7-818a-688e25359c99 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.157926 Jun 30 04:23:07.682604 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 432/842] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:07 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:23:08.123584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0bc9047f-48b2-4271-9955-066d6ab8a7ac tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:08.124764 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0bc9047f-48b2-4271-9955-066d6ab8a7ac tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:08.126546 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-afdc69e3-c3c0-4e3f-b9ae-9ac0ea8a0fe7 req-a1b9b32d-0962-418b-bf73-02b3f1ec4c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51354e88-a19f-433f-85b3-126269c921c4", "tag": "90e33ddf-37e0-40e5-ac04-e09a2cb58d98"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:23:08.131892 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0bc9047f-48b2-4271-9955-066d6ab8a7ac tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:08.132335 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0bc9047f-48b2-4271-9955-066d6ab8a7ac tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:08.133099 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0bc9047f-48b2-4271-9955-066d6ab8a7ac tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:08.133523 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0bc9047f-48b2-4271-9955-066d6ab8a7ac tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:08.135814 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-afdc69e3-c3c0-4e3f-b9ae-9ac0ea8a0fe7 req-a1b9b32d-0962-418b-bf73-02b3f1ec4c3f service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:08.136316 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-afdc69e3-c3c0-4e3f-b9ae-9ac0ea8a0fe7 req-a1b9b32d-0962-418b-bf73-02b3f1ec4c3f service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:08.148675 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-afdc69e3-c3c0-4e3f-b9ae-9ac0ea8a0fe7 req-a1b9b32d-0962-418b-bf73-02b3f1ec4c3f service nova] Creating event network-changed:90e33ddf-37e0-40e5-ac04-e09a2cb58d98 for instance 51354e88-a19f-433f-85b3-126269c921c4 on hv-cinder-84684 Jun 30 04:23:08.154549 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-afdc69e3-c3c0-4e3f-b9ae-9ac0ea8a0fe7 req-a1b9b32d-0962-418b-bf73-02b3f1ec4c3f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031830 Jun 30 04:23:08.155539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 433/843] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:23:08.164714 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0bc9047f-48b2-4271-9955-066d6ab8a7ac tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:23:08.261790 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0bc9047f-48b2-4271-9955-066d6ab8a7ac tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 204 len: 0 microversion: 2.1 time: 0.142006 Jun 30 04:23:08.262409 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 411/844] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:23:08 2022] DELETE /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:23:08.272059 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cd5e6ec7-fa91-4694-a993-e863147cd629 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:08.272803 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cd5e6ec7-fa91-4694-a993-e863147cd629 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:08.279946 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cd5e6ec7-fa91-4694-a993-e863147cd629 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:08.280475 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cd5e6ec7-fa91-4694-a993-e863147cd629 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:08.281717 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cd5e6ec7-fa91-4694-a993-e863147cd629 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:08.282551 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cd5e6ec7-fa91-4694-a993-e863147cd629 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:08.427375 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-cd5e6ec7-fa91-4694-a993-e863147cd629 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:08.435168 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cd5e6ec7-fa91-4694-a993-e863147cd629 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.167315 Jun 30 04:23:08.435747 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 434/845] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:08 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:08.700132 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6b091e77-6df2-43a6-926d-ebe1a0395308 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:08.700725 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6b091e77-6df2-43a6-926d-ebe1a0395308 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:08.707510 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6b091e77-6df2-43a6-926d-ebe1a0395308 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:08.707951 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6b091e77-6df2-43a6-926d-ebe1a0395308 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:08.708706 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6b091e77-6df2-43a6-926d-ebe1a0395308 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:08.709136 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6b091e77-6df2-43a6-926d-ebe1a0395308 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:08.845660 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6b091e77-6df2-43a6-926d-ebe1a0395308 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:08.853865 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6b091e77-6df2-43a6-926d-ebe1a0395308 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.158166 Jun 30 04:23:08.854435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 412/846] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:08 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:09.453383 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f66a6a6a-4408-4408-bc5d-94880520cd3b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:09.453958 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f66a6a6a-4408-4408-bc5d-94880520cd3b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:09.460999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f66a6a6a-4408-4408-bc5d-94880520cd3b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:09.461445 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f66a6a6a-4408-4408-bc5d-94880520cd3b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:09.462208 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f66a6a6a-4408-4408-bc5d-94880520cd3b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:09.462634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f66a6a6a-4408-4408-bc5d-94880520cd3b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:09.624234 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f66a6a6a-4408-4408-bc5d-94880520cd3b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:09.632377 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f66a6a6a-4408-4408-bc5d-94880520cd3b tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1567 microversion: 2.1 time: 0.183511 Jun 30 04:23:09.632929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 435/847] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:09 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:09.871726 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bdaeb049-737a-4e63-bff6-584d455fb40b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:09.872508 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bdaeb049-737a-4e63-bff6-584d455fb40b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:09.879991 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bdaeb049-737a-4e63-bff6-584d455fb40b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:09.880436 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bdaeb049-737a-4e63-bff6-584d455fb40b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:09.881208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bdaeb049-737a-4e63-bff6-584d455fb40b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:09.881661 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bdaeb049-737a-4e63-bff6-584d455fb40b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:10.079948 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bdaeb049-737a-4e63-bff6-584d455fb40b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:10.088302 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bdaeb049-737a-4e63-bff6-584d455fb40b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.220598 Jun 30 04:23:10.089149 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 413/848] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:09 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:10.514879 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-668be088-adff-4d8d-aa19-94e40bac82fd req-1284b71e-8373-49b5-90ce-494f077f1cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51354e88-a19f-433f-85b3-126269c921c4", "name": "network-vif-deleted", "tag": "90e33ddf-37e0-40e5-ac04-e09a2cb58d98"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:23:10.526516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-668be088-adff-4d8d-aa19-94e40bac82fd req-1284b71e-8373-49b5-90ce-494f077f1cf9 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:10.526961 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-668be088-adff-4d8d-aa19-94e40bac82fd req-1284b71e-8373-49b5-90ce-494f077f1cf9 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:10.539565 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-668be088-adff-4d8d-aa19-94e40bac82fd req-1284b71e-8373-49b5-90ce-494f077f1cf9 service nova] Creating event network-vif-deleted:90e33ddf-37e0-40e5-ac04-e09a2cb58d98 for instance 51354e88-a19f-433f-85b3-126269c921c4 on hv-cinder-84684 Jun 30 04:23:10.545777 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-668be088-adff-4d8d-aa19-94e40bac82fd req-1284b71e-8373-49b5-90ce-494f077f1cf9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034837 Jun 30 04:23:10.546416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 436/849] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:23:10.651350 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-51e32a80-3786-4dda-b4d6-47e50254e83a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:10.651958 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-51e32a80-3786-4dda-b4d6-47e50254e83a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:10.658628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-51e32a80-3786-4dda-b4d6-47e50254e83a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:10.659083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-51e32a80-3786-4dda-b4d6-47e50254e83a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:10.659861 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-51e32a80-3786-4dda-b4d6-47e50254e83a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:10.660293 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-51e32a80-3786-4dda-b4d6-47e50254e83a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:10.722247 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-51e32a80-3786-4dda-b4d6-47e50254e83a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfcd2137bf94726a25fea389ef24430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d0dd3cae1448049dc95fb347fd1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:10.730035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-51e32a80-3786-4dda-b4d6-47e50254e83a tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 200 len: 1219 microversion: 2.1 time: 0.083074 Jun 30 04:23:10.730977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 414/850] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:10 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:11.111187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-86057942-d611-459f-bc56-4a3dc9d4ce15 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:11.111844 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-86057942-d611-459f-bc56-4a3dc9d4ce15 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:11.118520 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-86057942-d611-459f-bc56-4a3dc9d4ce15 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:11.118966 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-86057942-d611-459f-bc56-4a3dc9d4ce15 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:11.120439 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-86057942-d611-459f-bc56-4a3dc9d4ce15 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:11.120866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-86057942-d611-459f-bc56-4a3dc9d4ce15 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:11.260649 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-86057942-d611-459f-bc56-4a3dc9d4ce15 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:11.269023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-86057942-d611-459f-bc56-4a3dc9d4ce15 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.163779 Jun 30 04:23:11.269596 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 437/851] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:11 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:11.751953 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-42d6a774-9615-400a-b5b3-75178aeca241 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:11.753048 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-42d6a774-9615-400a-b5b3-75178aeca241 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] [instance: 51354e88-a19f-433f-85b3-126269c921c4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:11.764352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42d6a774-9615-400a-b5b3-75178aeca241 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:11.765047 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42d6a774-9615-400a-b5b3-75178aeca241 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:11.766036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42d6a774-9615-400a-b5b3-75178aeca241 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:11.766517 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42d6a774-9615-400a-b5b3-75178aeca241 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:11.780830 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-42d6a774-9615-400a-b5b3-75178aeca241 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] HTTP exception thrown: Instance 51354e88-a19f-433f-85b3-126269c921c4 could not be found. Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-42d6a774-9615-400a-b5b3-75178aeca241 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Request method failure captured: Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 HTTP/1.1 Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSPUQXtrvEaLFTWyT-DioppOOHIBK6CqVVGorUnrtIdBNIkx-DgLMPwVJWyc5x-bQkJewDzjl9-KSHdlSOGammQ6oljCu5aAT-lMbPSxjmni7-0cItXDDGStZKkBEw8ZTlR7Sci3mwapA7tUXoGhKWt2SfDXw2PZOsMRd9HRfqBrmuw Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 62d0dd3cae1448049dc95fb347fd1a80 Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-TestShelveInstance-1069409963 Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:23:11.782511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/62d0dd3cae1448049dc95fb347fd1a80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_62d0dd3cae1448049dc95fb347fd1a80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/62d0dd3cae1448049dc95fb347fd1a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/62d0dd3cae1448049dc95fb347fd1a80"}]}] Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-TestShelveInstance-1069409963 Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 62d0dd3cae1448049dc95fb347fd1a80 Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-TestShelveInstance-1069409963 Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-TestShelveInstance-1069409963-project Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: ebfcd2137bf94726a25fea389ef24430 Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-TestShelveInstance-1069409963-project Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 51354e88-a19f-433f-85b3-126269c921c4 could not be found. Jun 30 04:23:11.784156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '51354e88-a19f-433f-85b3-126269c921c4'} Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51354e88-a19f-433f-85b3-126269c921c4 could not be found. Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:23:11.785180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51354e88-a19f-433f-85b3-126269c921c4 could not be found. Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51354e88-a19f-433f-85b3-126269c921c4 could not be found. Jun 30 04:23:11.786556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:23:11.787858 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-42d6a774-9615-400a-b5b3-75178aeca241 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Returning 404 to user: Instance 51354e88-a19f-433f-85b3-126269c921c4 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:23:11.787858 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-42d6a774-9615-400a-b5b3-75178aeca241 tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4" status: 404 len: 111 microversion: 2.1 time: 0.039469 Jun 30 04:23:11.787858 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 415/852] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:11 2022] GET /compute/v2.1/servers/51354e88-a19f-433f-85b3-126269c921c4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:23:11.949580 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-53899eb4-9013-4b4e-becb-ba0ead90b33d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] Calling method '.version_select at 0x7fb4800908b0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:11.969226 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-53899eb4-9013-4b4e-becb-ba0ead90b33d tempest-TestShelveInstance-1069409963 tempest-TestShelveInstance-1069409963-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-576365692" status: 202 len: 0 microversion: 2.1 time: 0.023511 Jun 30 04:23:11.969811 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 438/853] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 30 04:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-576365692 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:23:12.287644 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8158e943-5720-4494-bb56-f11c798c4309 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:12.288440 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8158e943-5720-4494-bb56-f11c798c4309 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:12.294819 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8158e943-5720-4494-bb56-f11c798c4309 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:12.295369 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8158e943-5720-4494-bb56-f11c798c4309 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:12.296155 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8158e943-5720-4494-bb56-f11c798c4309 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:12.296600 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8158e943-5720-4494-bb56-f11c798c4309 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:12.428597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8158e943-5720-4494-bb56-f11c798c4309 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:12.438116 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8158e943-5720-4494-bb56-f11c798c4309 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.154479 Jun 30 04:23:12.438651 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 416/854] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:12 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:13.456140 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-06b377e2-7596-4d61-8345-399e4a978c71 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:13.456877 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-06b377e2-7596-4d61-8345-399e4a978c71 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:13.464097 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06b377e2-7596-4d61-8345-399e4a978c71 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:13.464533 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06b377e2-7596-4d61-8345-399e4a978c71 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:13.465282 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06b377e2-7596-4d61-8345-399e4a978c71 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:13.465898 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-06b377e2-7596-4d61-8345-399e4a978c71 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:13.625187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-06b377e2-7596-4d61-8345-399e4a978c71 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:13.633808 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-06b377e2-7596-4d61-8345-399e4a978c71 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.182522 Jun 30 04:23:13.634665 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 439/855] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:13 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:14.652446 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1756a0a0-c5a4-45e6-902f-87aac565b831 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:14.653058 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1756a0a0-c5a4-45e6-902f-87aac565b831 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:14.660702 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1756a0a0-c5a4-45e6-902f-87aac565b831 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:14.661155 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1756a0a0-c5a4-45e6-902f-87aac565b831 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:14.662126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1756a0a0-c5a4-45e6-902f-87aac565b831 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:14.662558 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1756a0a0-c5a4-45e6-902f-87aac565b831 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:14.861992 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1756a0a0-c5a4-45e6-902f-87aac565b831 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:14.872382 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1756a0a0-c5a4-45e6-902f-87aac565b831 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.224427 Jun 30 04:23:14.872967 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 417/856] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:14 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:15.892705 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-61db0f0f-0d89-49ce-8528-c0e3f08b2435 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:15.893436 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-61db0f0f-0d89-49ce-8528-c0e3f08b2435 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:15.903264 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-61db0f0f-0d89-49ce-8528-c0e3f08b2435 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:15.904336 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-61db0f0f-0d89-49ce-8528-c0e3f08b2435 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:15.905748 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-61db0f0f-0d89-49ce-8528-c0e3f08b2435 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:15.906481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-61db0f0f-0d89-49ce-8528-c0e3f08b2435 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:16.045277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-61db0f0f-0d89-49ce-8528-c0e3f08b2435 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:16.053865 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-61db0f0f-0d89-49ce-8528-c0e3f08b2435 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.167587 Jun 30 04:23:16.054474 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 440/857] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:15 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:17.072359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a98d46ba-8d7e-4f17-aca6-8fc9cf9127f4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:17.073735 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a98d46ba-8d7e-4f17-aca6-8fc9cf9127f4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:17.081501 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a98d46ba-8d7e-4f17-aca6-8fc9cf9127f4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:17.082034 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a98d46ba-8d7e-4f17-aca6-8fc9cf9127f4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:17.082883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a98d46ba-8d7e-4f17-aca6-8fc9cf9127f4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:17.083415 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a98d46ba-8d7e-4f17-aca6-8fc9cf9127f4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:17.221515 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a98d46ba-8d7e-4f17-aca6-8fc9cf9127f4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:17.230358 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a98d46ba-8d7e-4f17-aca6-8fc9cf9127f4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.161979 Jun 30 04:23:17.231182 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 418/858] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:17 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:18.249001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d36ee6a5-f532-4496-95c4-f5e8c3489873 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:18.249001 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d36ee6a5-f532-4496-95c4-f5e8c3489873 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:18.257394 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d36ee6a5-f532-4496-95c4-f5e8c3489873 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:18.257942 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d36ee6a5-f532-4496-95c4-f5e8c3489873 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:18.258913 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d36ee6a5-f532-4496-95c4-f5e8c3489873 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:18.259487 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d36ee6a5-f532-4496-95c4-f5e8c3489873 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:18.442200 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d36ee6a5-f532-4496-95c4-f5e8c3489873 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:18.450390 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d36ee6a5-f532-4496-95c4-f5e8c3489873 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.206611 Jun 30 04:23:18.461318 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 441/859] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:18 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:19.467859 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-01794b76-7fb3-476c-b6a4-01d7c3333510 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:19.468561 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-01794b76-7fb3-476c-b6a4-01d7c3333510 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:19.476204 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-01794b76-7fb3-476c-b6a4-01d7c3333510 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:19.476643 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-01794b76-7fb3-476c-b6a4-01d7c3333510 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:19.477640 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-01794b76-7fb3-476c-b6a4-01d7c3333510 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:19.478079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-01794b76-7fb3-476c-b6a4-01d7c3333510 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:19.621723 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-01794b76-7fb3-476c-b6a4-01d7c3333510 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:19.631337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-01794b76-7fb3-476c-b6a4-01d7c3333510 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.167545 Jun 30 04:23:19.631936 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 419/860] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:19 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:20.653763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d1022ea9-5700-4e2c-be89-f35642919647 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:20.654801 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d1022ea9-5700-4e2c-be89-f35642919647 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:20.666652 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d1022ea9-5700-4e2c-be89-f35642919647 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:20.667443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d1022ea9-5700-4e2c-be89-f35642919647 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:20.668682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d1022ea9-5700-4e2c-be89-f35642919647 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:20.669397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d1022ea9-5700-4e2c-be89-f35642919647 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:20.813098 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d1022ea9-5700-4e2c-be89-f35642919647 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:20.823408 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d1022ea9-5700-4e2c-be89-f35642919647 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.176545 Jun 30 04:23:20.824059 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 442/861] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:20 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:21.844005 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b91228c2-3304-4664-a407-25a91f057283 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:21.844578 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b91228c2-3304-4664-a407-25a91f057283 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:21.851621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b91228c2-3304-4664-a407-25a91f057283 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:21.852054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b91228c2-3304-4664-a407-25a91f057283 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:21.852816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b91228c2-3304-4664-a407-25a91f057283 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:21.853250 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b91228c2-3304-4664-a407-25a91f057283 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:22.004152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b91228c2-3304-4664-a407-25a91f057283 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:22.016809 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b91228c2-3304-4664-a407-25a91f057283 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.178305 Jun 30 04:23:22.017384 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 420/862] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:21 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:23.038682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5d1e9bd8-e1b4-4431-b773-b4c579482848 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:23.039698 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5d1e9bd8-e1b4-4431-b773-b4c579482848 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:23.049334 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5d1e9bd8-e1b4-4431-b773-b4c579482848 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:23.049784 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5d1e9bd8-e1b4-4431-b773-b4c579482848 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:23.050547 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5d1e9bd8-e1b4-4431-b773-b4c579482848 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:23.050980 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5d1e9bd8-e1b4-4431-b773-b4c579482848 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:23.188608 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5d1e9bd8-e1b4-4431-b773-b4c579482848 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:23.197336 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5d1e9bd8-e1b4-4431-b773-b4c579482848 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.165239 Jun 30 04:23:23.197892 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 443/863] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:23 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:24.219040 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e41f07a6-2736-479f-a653-0cfd71c97f4f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:24.219807 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e41f07a6-2736-479f-a653-0cfd71c97f4f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:24.228016 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e41f07a6-2736-479f-a653-0cfd71c97f4f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:24.228550 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e41f07a6-2736-479f-a653-0cfd71c97f4f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:24.229448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e41f07a6-2736-479f-a653-0cfd71c97f4f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:24.229959 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e41f07a6-2736-479f-a653-0cfd71c97f4f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:24.366027 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e41f07a6-2736-479f-a653-0cfd71c97f4f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:24.374676 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e41f07a6-2736-479f-a653-0cfd71c97f4f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.162309 Jun 30 04:23:24.375338 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 421/864] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:24 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:25.396519 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-df81caea-b6b8-4388-a472-d05c292c2e33 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:25.397544 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-df81caea-b6b8-4388-a472-d05c292c2e33 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:25.409209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df81caea-b6b8-4388-a472-d05c292c2e33 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:25.409656 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df81caea-b6b8-4388-a472-d05c292c2e33 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:25.410407 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df81caea-b6b8-4388-a472-d05c292c2e33 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:25.410847 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df81caea-b6b8-4388-a472-d05c292c2e33 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:25.548523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-df81caea-b6b8-4388-a472-d05c292c2e33 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:25.557184 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-df81caea-b6b8-4388-a472-d05c292c2e33 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1723 microversion: 2.1 time: 0.167475 Jun 30 04:23:25.557758 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 444/865] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:25 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:26.579024 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f5eb519a-2108-4c0f-adfb-06263b172a7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:26.579658 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f5eb519a-2108-4c0f-adfb-06263b172a7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:26.582110 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:23:26.588000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5eb519a-2108-4c0f-adfb-06263b172a7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:26.588448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5eb519a-2108-4c0f-adfb-06263b172a7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:26.589216 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5eb519a-2108-4c0f-adfb-06263b172a7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:26.589648 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5eb519a-2108-4c0f-adfb-06263b172a7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:26.593255 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:23:26.742818 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f5eb519a-2108-4c0f-adfb-06263b172a7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:26.751331 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f5eb519a-2108-4c0f-adfb-06263b172a7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1700 microversion: 2.1 time: 0.178473 Jun 30 04:23:26.751902 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 422/866] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:26 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1700 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:26.767965 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-afa9c9b4-4da2-4c88-a753-3f1be9d8d644 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:23:26.774974 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-afa9c9b4-4da2-4c88-a753-3f1be9d8d644 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:26.775413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-afa9c9b4-4da2-4c88-a753-3f1be9d8d644 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:26.836313 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-afa9c9b4-4da2-4c88-a753-3f1be9d8d644 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Going to try to start instance {{(pid=118188) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 04:23:26.882415 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-afa9c9b4-4da2-4c88-a753-3f1be9d8d644 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/action" status: 202 len: 0 microversion: 2.1 time: 0.118482 Jun 30 04:23:26.883009 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 445/867] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:23:26 2022] POST /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:23:26.891351 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bc59c546-81bb-41f1-9833-018ce55f01a5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:26.891952 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bc59c546-81bb-41f1-9833-018ce55f01a5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:26.898529 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc59c546-81bb-41f1-9833-018ce55f01a5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:26.899054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc59c546-81bb-41f1-9833-018ce55f01a5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:26.899967 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc59c546-81bb-41f1-9833-018ce55f01a5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:26.900348 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bc59c546-81bb-41f1-9833-018ce55f01a5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:27.074885 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bc59c546-81bb-41f1-9833-018ce55f01a5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:27.083402 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bc59c546-81bb-41f1-9833-018ce55f01a5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1709 microversion: 2.1 time: 0.196033 Jun 30 04:23:27.084247 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 423/868] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:26 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1709 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:28.106886 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5c062451-6c69-4707-ab72-cfd636c6b094 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:28.107956 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5c062451-6c69-4707-ab72-cfd636c6b094 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:28.110874 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:23:28.116820 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5c062451-6c69-4707-ab72-cfd636c6b094 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:28.117254 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5c062451-6c69-4707-ab72-cfd636c6b094 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:28.118018 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5c062451-6c69-4707-ab72-cfd636c6b094 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:28.118458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5c062451-6c69-4707-ab72-cfd636c6b094 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:28.121851 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:23:28.257981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5c062451-6c69-4707-ab72-cfd636c6b094 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:28.267535 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5c062451-6c69-4707-ab72-cfd636c6b094 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1709 microversion: 2.1 time: 0.168460 Jun 30 04:23:28.267957 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 446/869] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:28 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:29.287428 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c5ac66cc-cb15-4a49-8f17-42622b845924 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:29.288067 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c5ac66cc-cb15-4a49-8f17-42622b845924 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:29.294668 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c5ac66cc-cb15-4a49-8f17-42622b845924 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:29.295045 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c5ac66cc-cb15-4a49-8f17-42622b845924 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:29.295835 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c5ac66cc-cb15-4a49-8f17-42622b845924 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:29.296268 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c5ac66cc-cb15-4a49-8f17-42622b845924 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:29.439766 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c5ac66cc-cb15-4a49-8f17-42622b845924 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:29.447845 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c5ac66cc-cb15-4a49-8f17-42622b845924 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1713 microversion: 2.1 time: 0.164623 Jun 30 04:23:29.448416 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 424/870] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:29 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1713 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:36.628349 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1038725714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-814051584", "security_groups": [{"name": "tempest-secgroup-smoke-779380356"}], "block_device_mapping_v2": [{"uuid": "07c72e79-2a2d-48a5-bc36-9547b9dc0cc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "db2948ec-060f-4621-8ce6-8119698c91b1"}]}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:23:36.745362 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] validate_networks() for [('db2948ec-060f-4621-8ce6-8119698c91b1', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:23:37.130053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:23:37.130595 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:23:37.131299 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:23:37.131814 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:23:37.132332 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:23:37.145038 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:37.145478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:37.146271 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:37.146729 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:37.163923 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Getting quotas for project c2fe0f4b2519494ea784cea098da6be3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:23:37.168000 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Getting quotas for user e269c6a656ff4721911ae25657eeedca and project c2fe0f4b2519494ea784cea098da6be3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:23:37.234010 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:23:37.236206 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07c72e79-2a2d-48a5-bc36-9547b9dc0cc2',volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:23:37.373186 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fad65046-0f0c-47fa-8096-332f6df0f1b5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.749280 Jun 30 04:23:37.373831 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 447/871] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:23:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:23:37.384184 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9670ba53-a9a5-49f3-bba1-6637b5d8b82a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:37.384873 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9670ba53-a9a5-49f3-bba1-6637b5d8b82a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:37.439619 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9670ba53-a9a5-49f3-bba1-6637b5d8b82a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:37.447002 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9670ba53-a9a5-49f3-bba1-6637b5d8b82a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1094 microversion: 2.1 time: 0.066980 Jun 30 04:23:37.447807 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 425/872] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:37 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:38.464644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-af13ee99-c3a4-4f40-b07f-56d50975e28b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:38.465422 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-af13ee99-c3a4-4f40-b07f-56d50975e28b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:38.475896 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-af13ee99-c3a4-4f40-b07f-56d50975e28b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:38.476509 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-af13ee99-c3a4-4f40-b07f-56d50975e28b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:38.477651 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-af13ee99-c3a4-4f40-b07f-56d50975e28b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:38.478339 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-af13ee99-c3a4-4f40-b07f-56d50975e28b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:38.575509 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-af13ee99-c3a4-4f40-b07f-56d50975e28b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:38.588443 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-af13ee99-c3a4-4f40-b07f-56d50975e28b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1210 microversion: 2.1 time: 0.128047 Jun 30 04:23:38.589010 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 448/873] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:38 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:39.606033 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-df62dd53-f1ec-4c2b-96f6-29dc993e0199 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:39.607574 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-df62dd53-f1ec-4c2b-96f6-29dc993e0199 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:39.610339 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=17 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:23:39.617761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df62dd53-f1ec-4c2b-96f6-29dc993e0199 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:39.618570 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df62dd53-f1ec-4c2b-96f6-29dc993e0199 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:39.619467 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df62dd53-f1ec-4c2b-96f6-29dc993e0199 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:39.620146 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df62dd53-f1ec-4c2b-96f6-29dc993e0199 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:39.745172 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-832b2013-9f22-4aa2-aa78-0788bd5c2132 req-530fcbec-1277-4013-ac72-bd570a45c0bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "679b1905-1999-4528-94b5-26d01c3768a5", "tag": "b82a599a-5700-469a-bad4-85ce45d68120"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:23:39.757822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-832b2013-9f22-4aa2-aa78-0788bd5c2132 req-530fcbec-1277-4013-ac72-bd570a45c0bf service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:39.758610 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-832b2013-9f22-4aa2-aa78-0788bd5c2132 req-530fcbec-1277-4013-ac72-bd570a45c0bf service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:39.775926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-832b2013-9f22-4aa2-aa78-0788bd5c2132 req-530fcbec-1277-4013-ac72-bd570a45c0bf service nova] Creating event network-changed:b82a599a-5700-469a-bad4-85ce45d68120 for instance 679b1905-1999-4528-94b5-26d01c3768a5 on hv-cinder-84684 Jun 30 04:23:39.783503 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-832b2013-9f22-4aa2-aa78-0788bd5c2132 req-530fcbec-1277-4013-ac72-bd570a45c0bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045586 Jun 30 04:23:39.784130 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 449/874] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:23:39.842662 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-df62dd53-f1ec-4c2b-96f6-29dc993e0199 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:39.850581 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-df62dd53-f1ec-4c2b-96f6-29dc993e0199 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1265 microversion: 2.1 time: 0.248413 Jun 30 04:23:39.851193 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 426/875] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:39 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:40.868578 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b23aa205-603e-4be8-b1b0-e61af059dee1 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:40.869271 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b23aa205-603e-4be8-b1b0-e61af059dee1 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:40.876266 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b23aa205-603e-4be8-b1b0-e61af059dee1 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:40.877339 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b23aa205-603e-4be8-b1b0-e61af059dee1 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:40.877511 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b23aa205-603e-4be8-b1b0-e61af059dee1 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:40.877887 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b23aa205-603e-4be8-b1b0-e61af059dee1 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:41.031035 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b23aa205-603e-4be8-b1b0-e61af059dee1 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:41.038869 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b23aa205-603e-4be8-b1b0-e61af059dee1 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1265 microversion: 2.1 time: 0.174591 Jun 30 04:23:41.039473 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 450/876] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:40 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:42.059941 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cfed478d-d325-4a01-afb3-6a469c88ca88 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:42.060885 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-cfed478d-d325-4a01-afb3-6a469c88ca88 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:42.069239 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cfed478d-d325-4a01-afb3-6a469c88ca88 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:42.069679 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cfed478d-d325-4a01-afb3-6a469c88ca88 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:42.070428 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cfed478d-d325-4a01-afb3-6a469c88ca88 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:42.070863 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cfed478d-d325-4a01-afb3-6a469c88ca88 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:42.495129 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-cfed478d-d325-4a01-afb3-6a469c88ca88 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:42.503231 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cfed478d-d325-4a01-afb3-6a469c88ca88 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1265 microversion: 2.1 time: 0.449809 Jun 30 04:23:42.503806 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 427/877] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:42 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1265 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:43.525654 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-70a076d5-8886-4947-bca4-a275c6fe5f7a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:43.526534 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-70a076d5-8886-4947-bca4-a275c6fe5f7a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:43.535573 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-70a076d5-8886-4947-bca4-a275c6fe5f7a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:43.536019 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-70a076d5-8886-4947-bca4-a275c6fe5f7a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:43.536770 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-70a076d5-8886-4947-bca4-a275c6fe5f7a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:43.537196 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-70a076d5-8886-4947-bca4-a275c6fe5f7a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:43.687158 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-70a076d5-8886-4947-bca4-a275c6fe5f7a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:43.699277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-70a076d5-8886-4947-bca4-a275c6fe5f7a tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1265 microversion: 2.1 time: 0.180588 Jun 30 04:23:43.700153 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 451/878] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:43 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:44.721252 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6e489321-7f34-420d-b779-967478e88efe tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:44.722378 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6e489321-7f34-420d-b779-967478e88efe tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:44.733227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6e489321-7f34-420d-b779-967478e88efe tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:44.733963 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6e489321-7f34-420d-b779-967478e88efe tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:44.735250 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6e489321-7f34-420d-b779-967478e88efe tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:44.735959 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6e489321-7f34-420d-b779-967478e88efe tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:44.877837 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6e489321-7f34-420d-b779-967478e88efe tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:44.885936 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6e489321-7f34-420d-b779-967478e88efe tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1265 microversion: 2.1 time: 0.171311 Jun 30 04:23:44.886518 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 428/879] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:44 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:45.907550 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8d8abbb5-ab70-4582-aeb3-6f660944985c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:45.908469 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8d8abbb5-ab70-4582-aeb3-6f660944985c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:45.919431 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8d8abbb5-ab70-4582-aeb3-6f660944985c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:45.920165 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8d8abbb5-ab70-4582-aeb3-6f660944985c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:45.921407 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8d8abbb5-ab70-4582-aeb3-6f660944985c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:45.922117 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8d8abbb5-ab70-4582-aeb3-6f660944985c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:46.063652 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8d8abbb5-ab70-4582-aeb3-6f660944985c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:46.071749 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8d8abbb5-ab70-4582-aeb3-6f660944985c tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1265 microversion: 2.1 time: 0.170873 Jun 30 04:23:46.072294 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 452/880] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:45 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:47.095700 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dd5ae82c-e284-459d-a6df-6ab204aeac04 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:47.097116 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dd5ae82c-e284-459d-a6df-6ab204aeac04 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:47.104612 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd5ae82c-e284-459d-a6df-6ab204aeac04 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:47.105122 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd5ae82c-e284-459d-a6df-6ab204aeac04 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:47.106035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd5ae82c-e284-459d-a6df-6ab204aeac04 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:47.106543 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd5ae82c-e284-459d-a6df-6ab204aeac04 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:47.256751 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dd5ae82c-e284-459d-a6df-6ab204aeac04 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:47.268899 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dd5ae82c-e284-459d-a6df-6ab204aeac04 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1265 microversion: 2.1 time: 0.179615 Jun 30 04:23:47.269702 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 429/881] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:47 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:48.289665 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5653d398-6438-435f-91da-7298074d228b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:48.290294 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5653d398-6438-435f-91da-7298074d228b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:48.293071 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:23:48.293866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=6 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:23:48.300526 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5653d398-6438-435f-91da-7298074d228b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:48.301098 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5653d398-6438-435f-91da-7298074d228b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:48.301875 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5653d398-6438-435f-91da-7298074d228b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:48.302324 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5653d398-6438-435f-91da-7298074d228b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:48.435996 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5653d398-6438-435f-91da-7298074d228b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:48.443944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5653d398-6438-435f-91da-7298074d228b tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1265 microversion: 2.1 time: 0.158275 Jun 30 04:23:48.444742 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 453/882] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:48 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:49.463247 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-35d918fc-165d-467e-ac9b-cfdfeae25068 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:49.464095 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-35d918fc-165d-467e-ac9b-cfdfeae25068 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:49.466445 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:23:49.473568 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35d918fc-165d-467e-ac9b-cfdfeae25068 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:49.474013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35d918fc-165d-467e-ac9b-cfdfeae25068 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:49.474756 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35d918fc-165d-467e-ac9b-cfdfeae25068 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:49.475218 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35d918fc-165d-467e-ac9b-cfdfeae25068 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:49.619724 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-35d918fc-165d-467e-ac9b-cfdfeae25068 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:49.630606 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-35d918fc-165d-467e-ac9b-cfdfeae25068 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1265 microversion: 2.1 time: 0.172323 Jun 30 04:23:49.631225 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 430/883] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:49 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:49.989990 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-b46232f4-4fbd-44b4-8bfe-0dc903a1fc54 req-b57ba11f-4bea-47fb-9307-8061d7ee8ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679b1905-1999-4528-94b5-26d01c3768a5", "name": "network-vif-plugged", "status": "completed", "tag": "b82a599a-5700-469a-bad4-85ce45d68120"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:23:49.999533 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-b46232f4-4fbd-44b4-8bfe-0dc903a1fc54 req-b57ba11f-4bea-47fb-9307-8061d7ee8ffd service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:49.999973 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-b46232f4-4fbd-44b4-8bfe-0dc903a1fc54 req-b57ba11f-4bea-47fb-9307-8061d7ee8ffd service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:50.011514 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-b46232f4-4fbd-44b4-8bfe-0dc903a1fc54 req-b57ba11f-4bea-47fb-9307-8061d7ee8ffd service nova] Creating event network-vif-plugged:b82a599a-5700-469a-bad4-85ce45d68120 for instance 679b1905-1999-4528-94b5-26d01c3768a5 on hv-cinder-84684 Jun 30 04:23:50.016510 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-b46232f4-4fbd-44b4-8bfe-0dc903a1fc54 req-b57ba11f-4bea-47fb-9307-8061d7ee8ffd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030355 Jun 30 04:23:50.017103 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 454/884] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:23:50.651632 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1c18ba55-38af-4ffb-ae3c-3ac2eec354f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:50.652608 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1c18ba55-38af-4ffb-ae3c-3ac2eec354f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:50.664647 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1c18ba55-38af-4ffb-ae3c-3ac2eec354f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:50.665335 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1c18ba55-38af-4ffb-ae3c-3ac2eec354f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:50.666622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1c18ba55-38af-4ffb-ae3c-3ac2eec354f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:50.667389 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1c18ba55-38af-4ffb-ae3c-3ac2eec354f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:50.816798 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1c18ba55-38af-4ffb-ae3c-3ac2eec354f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:50.824411 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1c18ba55-38af-4ffb-ae3c-3ac2eec354f4 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1265 microversion: 2.1 time: 0.179914 Jun 30 04:23:50.824977 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 431/885] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:50 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:51.844054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7aa3c74c-e558-42c3-9164-dabda915f9bb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:51.844673 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7aa3c74c-e558-42c3-9164-dabda915f9bb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:51.851435 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7aa3c74c-e558-42c3-9164-dabda915f9bb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:51.851880 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7aa3c74c-e558-42c3-9164-dabda915f9bb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:51.852634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7aa3c74c-e558-42c3-9164-dabda915f9bb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:51.853090 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7aa3c74c-e558-42c3-9164-dabda915f9bb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:51.988617 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7aa3c74c-e558-42c3-9164-dabda915f9bb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:52.000218 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7aa3c74c-e558-42c3-9164-dabda915f9bb tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1451 microversion: 2.1 time: 0.161125 Jun 30 04:23:52.000991 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 455/886] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:51 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:52.023506 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5ba1b1b5-0b63-473b-91a7-6438f0844e8d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:23:52.024111 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5ba1b1b5-0b63-473b-91a7-6438f0844e8d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:23:52.030958 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5ba1b1b5-0b63-473b-91a7-6438f0844e8d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:52.031435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5ba1b1b5-0b63-473b-91a7-6438f0844e8d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:52.032205 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5ba1b1b5-0b63-473b-91a7-6438f0844e8d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:52.032633 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5ba1b1b5-0b63-473b-91a7-6438f0844e8d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:52.167193 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5ba1b1b5-0b63-473b-91a7-6438f0844e8d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:23:52.175119 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5ba1b1b5-0b63-473b-91a7-6438f0844e8d tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1451 microversion: 2.1 time: 0.155943 Jun 30 04:23:52.175726 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 432/887] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:23:52 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:23:54.036478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-862b06ac-bba8-4afa-a88d-c850bec31c62 req-e803327f-79b9-4415-be26-ce051a2e4399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "679b1905-1999-4528-94b5-26d01c3768a5", "tag": "b82a599a-5700-469a-bad4-85ce45d68120"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:23:54.044985 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-862b06ac-bba8-4afa-a88d-c850bec31c62 req-e803327f-79b9-4415-be26-ce051a2e4399 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:23:54.045430 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-862b06ac-bba8-4afa-a88d-c850bec31c62 req-e803327f-79b9-4415-be26-ce051a2e4399 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:23:54.056298 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-862b06ac-bba8-4afa-a88d-c850bec31c62 req-e803327f-79b9-4415-be26-ce051a2e4399 service nova] Creating event network-changed:b82a599a-5700-469a-bad4-85ce45d68120 for instance 679b1905-1999-4528-94b5-26d01c3768a5 on hv-cinder-84684 Jun 30 04:23:54.061117 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-862b06ac-bba8-4afa-a88d-c850bec31c62 req-e803327f-79b9-4415-be26-ce051a2e4399 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028530 Jun 30 04:23:54.061684 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 456/888] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:24:02.630774 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-304b4386-0cba-456a-977f-48bc1a5e2029 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:02.631313 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-304b4386-0cba-456a-977f-48bc1a5e2029 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:02.633665 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=23 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:24:02.634331 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=42 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:24:02.641123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-304b4386-0cba-456a-977f-48bc1a5e2029 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:02.641587 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-304b4386-0cba-456a-977f-48bc1a5e2029 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:02.642331 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-304b4386-0cba-456a-977f-48bc1a5e2029 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:02.642761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-304b4386-0cba-456a-977f-48bc1a5e2029 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:02.727393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-304b4386-0cba-456a-977f-48bc1a5e2029 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lazy-loading 'services' on Instance uuid b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:24:02.816193 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-304b4386-0cba-456a-977f-48bc1a5e2029 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/os-volume_attachments/1157ef30-bf14-4d51-805f-01a82e80b631" status: 202 len: 0 microversion: 2.1 time: 0.189391 Jun 30 04:24:02.817138 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 433/889] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:24:02 2022] DELETE /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/os-volume_attachments/1157ef30-bf14-4d51-805f-01a82e80b631 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:24:03.934508 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9270b899-9795-4393-873f-5a8ce47b1f55 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:24:03.937192 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:24:03.944700 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9270b899-9795-4393-873f-5a8ce47b1f55 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:03.945331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9270b899-9795-4393-873f-5a8ce47b1f55 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:03.948154 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=50 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:24:03.969429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9270b899-9795-4393-873f-5a8ce47b1f55 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Going to try to stop instance {{(pid=118188) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 04:24:04.015089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9270b899-9795-4393-873f-5a8ce47b1f55 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/action" status: 202 len: 0 microversion: 2.1 time: 0.088481 Jun 30 04:24:04.015755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 457/890] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:24:03 2022] POST /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:24:04.026116 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fa6ef14f-fd75-457b-ab05-dbc0a9f66acf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:04.026902 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fa6ef14f-fd75-457b-ab05-dbc0a9f66acf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:04.033952 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa6ef14f-fd75-457b-ab05-dbc0a9f66acf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:04.034451 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa6ef14f-fd75-457b-ab05-dbc0a9f66acf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:04.035355 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa6ef14f-fd75-457b-ab05-dbc0a9f66acf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:04.035832 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa6ef14f-fd75-457b-ab05-dbc0a9f66acf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:04.178091 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fa6ef14f-fd75-457b-ab05-dbc0a9f66acf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:04.185959 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fa6ef14f-fd75-457b-ab05-dbc0a9f66acf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1677 microversion: 2.1 time: 0.165258 Jun 30 04:24:04.187299 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 434/891] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:04 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:05.204607 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f3047b4a-18fc-4921-a759-bed93e0e83e8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:05.205325 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f3047b4a-18fc-4921-a759-bed93e0e83e8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:05.211769 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f3047b4a-18fc-4921-a759-bed93e0e83e8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:05.212215 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f3047b4a-18fc-4921-a759-bed93e0e83e8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:05.213115 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f3047b4a-18fc-4921-a759-bed93e0e83e8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:05.213563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f3047b4a-18fc-4921-a759-bed93e0e83e8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:05.354216 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f3047b4a-18fc-4921-a759-bed93e0e83e8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:05.362173 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f3047b4a-18fc-4921-a759-bed93e0e83e8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1677 microversion: 2.1 time: 0.162339 Jun 30 04:24:05.362749 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 458/892] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:05 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:06.384030 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a1cc2157-bd96-4724-8a5f-1e664f86e43c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:06.385321 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a1cc2157-bd96-4724-8a5f-1e664f86e43c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:06.396634 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1cc2157-bd96-4724-8a5f-1e664f86e43c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:06.397812 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1cc2157-bd96-4724-8a5f-1e664f86e43c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:06.399088 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1cc2157-bd96-4724-8a5f-1e664f86e43c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:06.399970 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1cc2157-bd96-4724-8a5f-1e664f86e43c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:06.538090 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a1cc2157-bd96-4724-8a5f-1e664f86e43c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:06.545863 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a1cc2157-bd96-4724-8a5f-1e664f86e43c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1677 microversion: 2.1 time: 0.168436 Jun 30 04:24:06.546456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 435/893] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:06 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:07.565916 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-58496318-35c4-4a60-a0c8-7049638cd679 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:07.566547 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-58496318-35c4-4a60-a0c8-7049638cd679 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:07.574639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-58496318-35c4-4a60-a0c8-7049638cd679 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:07.575086 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-58496318-35c4-4a60-a0c8-7049638cd679 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:07.575883 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-58496318-35c4-4a60-a0c8-7049638cd679 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:07.576311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-58496318-35c4-4a60-a0c8-7049638cd679 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:07.717861 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-58496318-35c4-4a60-a0c8-7049638cd679 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:07.725527 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-58496318-35c4-4a60-a0c8-7049638cd679 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1677 microversion: 2.1 time: 0.165453 Jun 30 04:24:07.726115 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 459/894] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:07 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:08.747011 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a872eef6-194c-4b94-9434-328a704844a4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:08.747634 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a872eef6-194c-4b94-9434-328a704844a4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:08.754695 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a872eef6-194c-4b94-9434-328a704844a4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:08.755143 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a872eef6-194c-4b94-9434-328a704844a4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:08.755935 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a872eef6-194c-4b94-9434-328a704844a4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:08.756373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a872eef6-194c-4b94-9434-328a704844a4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:08.898883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a872eef6-194c-4b94-9434-328a704844a4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:08.907947 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a872eef6-194c-4b94-9434-328a704844a4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1677 microversion: 2.1 time: 0.166649 Jun 30 04:24:08.908525 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 436/895] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:08 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:09.929637 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d8c27aeb-3c86-49d3-acdc-97131bffbf98 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:09.930510 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d8c27aeb-3c86-49d3-acdc-97131bffbf98 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:09.942165 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8c27aeb-3c86-49d3-acdc-97131bffbf98 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:09.942885 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8c27aeb-3c86-49d3-acdc-97131bffbf98 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:09.944183 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8c27aeb-3c86-49d3-acdc-97131bffbf98 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:09.944895 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8c27aeb-3c86-49d3-acdc-97131bffbf98 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:10.089562 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d8c27aeb-3c86-49d3-acdc-97131bffbf98 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:10.097421 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d8c27aeb-3c86-49d3-acdc-97131bffbf98 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1677 microversion: 2.1 time: 0.174381 Jun 30 04:24:10.097998 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 460/896] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:09 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:11.119438 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-99ce79a1-7c24-48f4-b861-f7116bd19f6d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:11.120542 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-99ce79a1-7c24-48f4-b861-f7116bd19f6d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:11.128295 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-99ce79a1-7c24-48f4-b861-f7116bd19f6d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:11.128801 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-99ce79a1-7c24-48f4-b861-f7116bd19f6d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:11.129647 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-99ce79a1-7c24-48f4-b861-f7116bd19f6d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:11.130129 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-99ce79a1-7c24-48f4-b861-f7116bd19f6d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:11.264554 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-99ce79a1-7c24-48f4-b861-f7116bd19f6d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:11.272641 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-99ce79a1-7c24-48f4-b861-f7116bd19f6d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1677 microversion: 2.1 time: 0.159421 Jun 30 04:24:11.273222 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 437/897] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:11 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:12.293862 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-5d97e17b-019b-4cfa-97da-5a739a5534c3 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:12.294535 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-5d97e17b-019b-4cfa-97da-5a739a5534c3 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:12.301879 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5d97e17b-019b-4cfa-97da-5a739a5534c3 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:12.302373 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5d97e17b-019b-4cfa-97da-5a739a5534c3 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:12.303245 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5d97e17b-019b-4cfa-97da-5a739a5534c3 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:12.303722 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-5d97e17b-019b-4cfa-97da-5a739a5534c3 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:12.450842 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-5d97e17b-019b-4cfa-97da-5a739a5534c3 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:12.458834 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-5d97e17b-019b-4cfa-97da-5a739a5534c3 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1677 microversion: 2.1 time: 0.171424 Jun 30 04:24:12.459419 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 461/898] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:12 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:13.480080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0cf3fa4b-895d-4224-abb4-7d7cb76aeb1a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:13.481139 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0cf3fa4b-895d-4224-abb4-7d7cb76aeb1a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:13.492662 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0cf3fa4b-895d-4224-abb4-7d7cb76aeb1a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:13.493413 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0cf3fa4b-895d-4224-abb4-7d7cb76aeb1a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:13.494695 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0cf3fa4b-895d-4224-abb4-7d7cb76aeb1a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:13.495471 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0cf3fa4b-895d-4224-abb4-7d7cb76aeb1a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:13.633160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0cf3fa4b-895d-4224-abb4-7d7cb76aeb1a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:13.645351 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0cf3fa4b-895d-4224-abb4-7d7cb76aeb1a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1677 microversion: 2.1 time: 0.171624 Jun 30 04:24:13.646153 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 438/899] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:13 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:14.669113 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ab0d5f29-fc08-4a75-9922-ac157341850c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:14.669849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ab0d5f29-fc08-4a75-9922-ac157341850c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:14.678101 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ab0d5f29-fc08-4a75-9922-ac157341850c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:14.678629 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ab0d5f29-fc08-4a75-9922-ac157341850c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:14.679566 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ab0d5f29-fc08-4a75-9922-ac157341850c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:14.680079 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ab0d5f29-fc08-4a75-9922-ac157341850c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:14.816524 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ab0d5f29-fc08-4a75-9922-ac157341850c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:14.825941 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ab0d5f29-fc08-4a75-9922-ac157341850c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1654 microversion: 2.1 time: 0.163003 Jun 30 04:24:14.826405 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 462/900] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:14 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1654 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:14.842918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fc21211a-4693-4acc-ad92-dd6a731e59cc tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:24:14.849723 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fc21211a-4693-4acc-ad92-dd6a731e59cc tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:14.850203 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fc21211a-4693-4acc-ad92-dd6a731e59cc tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:14.872474 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fc21211a-4693-4acc-ad92-dd6a731e59cc tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Going to try to start instance {{(pid=118187) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 04:24:14.920270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fc21211a-4693-4acc-ad92-dd6a731e59cc tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/action" status: 202 len: 0 microversion: 2.1 time: 0.081699 Jun 30 04:24:14.920865 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 439/901] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 30 04:24:14 2022] POST /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 04:24:14.929940 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7a6e94e0-4baf-40b9-a021-2a55be43aa54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:14.930551 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7a6e94e0-4baf-40b9-a021-2a55be43aa54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:14.937801 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7a6e94e0-4baf-40b9-a021-2a55be43aa54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:14.938608 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7a6e94e0-4baf-40b9-a021-2a55be43aa54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:14.939582 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7a6e94e0-4baf-40b9-a021-2a55be43aa54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:14.940094 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7a6e94e0-4baf-40b9-a021-2a55be43aa54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:15.113229 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7a6e94e0-4baf-40b9-a021-2a55be43aa54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:15.121390 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7a6e94e0-4baf-40b9-a021-2a55be43aa54 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1663 microversion: 2.1 time: 0.195265 Jun 30 04:24:15.121963 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 463/902] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:14 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1663 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:16.145903 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b17cb50e-4ee0-4282-b600-61d8c08e2ef9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:16.146912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b17cb50e-4ee0-4282-b600-61d8c08e2ef9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:16.158109 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b17cb50e-4ee0-4282-b600-61d8c08e2ef9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:16.158838 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b17cb50e-4ee0-4282-b600-61d8c08e2ef9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:16.160169 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b17cb50e-4ee0-4282-b600-61d8c08e2ef9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:16.160922 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b17cb50e-4ee0-4282-b600-61d8c08e2ef9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:16.304154 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b17cb50e-4ee0-4282-b600-61d8c08e2ef9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:16.311929 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b17cb50e-4ee0-4282-b600-61d8c08e2ef9 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1663 microversion: 2.1 time: 0.174848 Jun 30 04:24:16.312511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 440/903] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:16 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:17.334641 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ff12da21-7de8-4cfa-b4c8-7b001c17f888 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:17.335274 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ff12da21-7de8-4cfa-b4c8-7b001c17f888 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:17.342784 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff12da21-7de8-4cfa-b4c8-7b001c17f888 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:17.343267 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff12da21-7de8-4cfa-b4c8-7b001c17f888 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:17.344012 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff12da21-7de8-4cfa-b4c8-7b001c17f888 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:17.344502 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ff12da21-7de8-4cfa-b4c8-7b001c17f888 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:17.492099 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ff12da21-7de8-4cfa-b4c8-7b001c17f888 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:17.503469 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ff12da21-7de8-4cfa-b4c8-7b001c17f888 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1667 microversion: 2.1 time: 0.172429 Jun 30 04:24:17.504213 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 464/904] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:17 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1667 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:30.372355 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 04:24:30.374754 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Thu Jun 30 04:24:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 04:24:50.059913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f6983ef7-00eb-428e-83f1-9cb1bf49fbf5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:50.061138 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f6983ef7-00eb-428e-83f1-9cb1bf49fbf5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:50.064492 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=16 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:24:50.065277 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:24:50.071929 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f6983ef7-00eb-428e-83f1-9cb1bf49fbf5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:50.072362 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f6983ef7-00eb-428e-83f1-9cb1bf49fbf5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:50.073131 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f6983ef7-00eb-428e-83f1-9cb1bf49fbf5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:50.073562 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f6983ef7-00eb-428e-83f1-9cb1bf49fbf5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:50.112815 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f6983ef7-00eb-428e-83f1-9cb1bf49fbf5 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059745 Jun 30 04:24:50.113373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 441/905] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:24:50 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 04:24:50.185334 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-94c94b9a-09d6-40a1-82f2-4252f7c62236 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:50.185921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-94c94b9a-09d6-40a1-82f2-4252f7c62236 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:50.188054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=15 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:24:50.188749 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:24:50.194529 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-94c94b9a-09d6-40a1-82f2-4252f7c62236 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:50.194979 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-94c94b9a-09d6-40a1-82f2-4252f7c62236 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:50.195847 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-94c94b9a-09d6-40a1-82f2-4252f7c62236 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:50.196277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-94c94b9a-09d6-40a1-82f2-4252f7c62236 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:50.225135 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-94c94b9a-09d6-40a1-82f2-4252f7c62236 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:24:50.311330 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-94c94b9a-09d6-40a1-82f2-4252f7c62236 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 204 len: 0 microversion: 2.1 time: 0.129654 Jun 30 04:24:50.311920 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 465/906] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:24:50 2022] DELETE /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:24:50.320620 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0ce4879b-9f2d-446e-8296-827d630f314b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:50.321233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0ce4879b-9f2d-446e-8296-827d630f314b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:50.327351 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ce4879b-9f2d-446e-8296-827d630f314b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:50.327797 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ce4879b-9f2d-446e-8296-827d630f314b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:50.328553 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ce4879b-9f2d-446e-8296-827d630f314b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:50.328982 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ce4879b-9f2d-446e-8296-827d630f314b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:50.471936 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0ce4879b-9f2d-446e-8296-827d630f314b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:50.479965 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0ce4879b-9f2d-446e-8296-827d630f314b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1673 microversion: 2.1 time: 0.163507 Jun 30 04:24:50.480540 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 442/907] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:50 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:51.503424 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a6bf5a61-df3a-47ca-9a87-3472584e6a3b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:51.504643 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a6bf5a61-df3a-47ca-9a87-3472584e6a3b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:51.512209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6bf5a61-df3a-47ca-9a87-3472584e6a3b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:51.512659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6bf5a61-df3a-47ca-9a87-3472584e6a3b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:51.513418 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6bf5a61-df3a-47ca-9a87-3472584e6a3b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:51.513856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6bf5a61-df3a-47ca-9a87-3472584e6a3b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:51.654493 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a6bf5a61-df3a-47ca-9a87-3472584e6a3b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:51.663401 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a6bf5a61-df3a-47ca-9a87-3472584e6a3b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1673 microversion: 2.1 time: 0.167164 Jun 30 04:24:51.663981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 466/908] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:51 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:52.680511 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b5d85d5a-9dde-452a-b805-055da0d97642 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:52.681101 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b5d85d5a-9dde-452a-b805-055da0d97642 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:52.688088 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5d85d5a-9dde-452a-b805-055da0d97642 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:52.688536 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5d85d5a-9dde-452a-b805-055da0d97642 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:52.689296 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5d85d5a-9dde-452a-b805-055da0d97642 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:52.689722 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5d85d5a-9dde-452a-b805-055da0d97642 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:52.957658 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b5d85d5a-9dde-452a-b805-055da0d97642 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:52.966764 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b5d85d5a-9dde-452a-b805-055da0d97642 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 200 len: 1673 microversion: 2.1 time: 0.290213 Jun 30 04:24:52.967427 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 443/909] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:52 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 1673 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:53.434094 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-bbf12936-9d45-45a6-8373-a147cdc4ccf2 req-0daed2a6-b4c8-446a-8537-46ee49daad4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5", "name": "network-vif-deleted", "tag": "92d5d28e-901e-4fdd-a753-3d722a745dcb"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:24:53.443932 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-bbf12936-9d45-45a6-8373-a147cdc4ccf2 req-0daed2a6-b4c8-446a-8537-46ee49daad4e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:53.444528 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-bbf12936-9d45-45a6-8373-a147cdc4ccf2 req-0daed2a6-b4c8-446a-8537-46ee49daad4e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:53.456627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-bbf12936-9d45-45a6-8373-a147cdc4ccf2 req-0daed2a6-b4c8-446a-8537-46ee49daad4e service nova] Creating event network-vif-deleted:92d5d28e-901e-4fdd-a753-3d722a745dcb for instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 on hv-cinder-84684 Jun 30 04:24:53.462434 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-bbf12936-9d45-45a6-8373-a147cdc4ccf2 req-0daed2a6-b4c8-446a-8537-46ee49daad4e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 Jun 30 04:24:53.463080 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 467/910] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:24:53.985922 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2a55c362-2979-4e0e-95b2-f9df09aefc0c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:53.986631 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2a55c362-2979-4e0e-95b2-f9df09aefc0c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:53.993855 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a55c362-2979-4e0e-95b2-f9df09aefc0c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:53.994410 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a55c362-2979-4e0e-95b2-f9df09aefc0c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:53.995270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a55c362-2979-4e0e-95b2-f9df09aefc0c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:53.995789 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a55c362-2979-4e0e-95b2-f9df09aefc0c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:54.009740 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-2a55c362-2979-4e0e-95b2-f9df09aefc0c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] HTTP exception thrown: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2a55c362-2979-4e0e-95b2-f9df09aefc0c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Request method failure captured: Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 HTTP/1.1 Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSTl_w5qmBIAWUgXumxbrVIN3UaosrqJIrLTjomDKY_UjsEd0Z82KaVZxFKyu-R15kkUOCiB_qQPa25LHQo7FqgOBKOFu-GN9r6TW593MrcCbijMHvGf04DcyKXBwKq90KIvuxf_z7VQwUZsQj6GziXCT4w8Zz-LaeTjsaCA_XWwCWg Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:24:54.011610 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cec258de3eea4a12a7bd9b2b9832dce6"}]}] Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: a432229e175149b0bc254f19af8007fa Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:24:54.013079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': 'b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5'} Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:24:54.014123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:24:54.016435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:24:54.018324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2a55c362-2979-4e0e-95b2-f9df09aefc0c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Returning 404 to user: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:24:54.018324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2a55c362-2979-4e0e-95b2-f9df09aefc0c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 404 len: 111 microversion: 2.1 time: 0.031318 Jun 30 04:24:54.018324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 444/911] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:53 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:24:54.025106 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fecaa755-e4e1-4373-8648-0f13d6025bfb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '.version_select at 0x7fb4800b3310>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:54.044603 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fecaa755-e4e1-4373-8648-0f13d6025bfb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755890047" status: 202 len: 0 microversion: 2.1 time: 0.024507 Jun 30 04:24:54.045179 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 468/912] 10.222.0.13 () {58 vars in 1217 bytes} [Thu Jun 30 04:24:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755890047 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:24:54.691240 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a00e1c16-4200-432d-8e68-24ca53f9cdbe tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'create', calling method: .version_select at 0x7fb48010ae50>, body: {"keypair": {"name": "tempest-keypair-1432420252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9Y6QazlQMFiCat9+BFVf7s9GsilgykWEpXl/CLx4hkNWsaHSMFxffsegiks5HB1is06AjPm6RRIGwEbZOFWWsvT6cjGLTj3Eb+oME4ssjl5UzEfeUlASg/JB4VVwzniw=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:24:54.706250 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-a00e1c16-4200-432d-8e68-24ca53f9cdbe tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Getting quotas for project cec258de3eea4a12a7bd9b2b9832dce6. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:24:54.710573 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-a00e1c16-4200-432d-8e68-24ca53f9cdbe tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Getting quotas for user a432229e175149b0bc254f19af8007fa and project cec258de3eea4a12a7bd9b2b9832dce6. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:24:54.738991 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a00e1c16-4200-432d-8e68-24ca53f9cdbe tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051749 Jun 30 04:24:54.739858 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 445/913] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 30 04:24:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:24:56.072526 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-425437640", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ae8070a-7682-4fda-9ac2-70bc78e189c1"}], "security_groups": [{"name": "tempest-securitygroup--2079848664"}], "key_name": "tempest-keypair-1432420252", "user_data": "}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:24:56.176498 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] validate_networks() for [('6ae8070a-7682-4fda-9ac2-70bc78e189c1', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:24:56.571966 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:24:56.572390 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:24:56.572865 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:24:56.573275 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:24:56.573682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:24:56.583468 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:56.583667 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:56.584412 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:24:56.584849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:24:56.602113 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Getting quotas for project cec258de3eea4a12a7bd9b2b9832dce6. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:24:56.606730 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Getting quotas for user a432229e175149b0bc254f19af8007fa and project cec258de3eea4a12a7bd9b2b9832dce6. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:24:56.622502 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:24:56.626395 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:24:56.675700 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8aa99bf4-aeef-4902-b99d-946c4f47e736 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.608946 Jun 30 04:24:56.676383 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 469/914] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:24:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:24:56.687384 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bd87ee36-b715-4491-a242-76344422ece0 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:56.688039 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bd87ee36-b715-4491-a242-76344422ece0 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:56.747076 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bd87ee36-b715-4491-a242-76344422ece0 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:56.756635 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bd87ee36-b715-4491-a242-76344422ece0 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1237 microversion: 2.1 time: 0.073818 Jun 30 04:24:56.757218 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 446/915] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:56 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:57.774464 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c8eec62b-e272-4d24-b5af-29a617405abf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:57.775198 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c8eec62b-e272-4d24-b5af-29a617405abf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:57.828030 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c8eec62b-e272-4d24-b5af-29a617405abf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:57.835238 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c8eec62b-e272-4d24-b5af-29a617405abf tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1237 microversion: 2.1 time: 0.065861 Jun 30 04:24:57.835814 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 470/916] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:57 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:58.852157 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bb6078a2-1787-4ab0-975a-9b843706b9a8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:58.852888 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bb6078a2-1787-4ab0-975a-9b843706b9a8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:58.905324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bb6078a2-1787-4ab0-975a-9b843706b9a8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:58.912464 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bb6078a2-1787-4ab0-975a-9b843706b9a8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1237 microversion: 2.1 time: 0.064373 Jun 30 04:24:58.913048 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 447/917] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:58 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:24:59.931829 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-22ce0dc8-dac7-4bf7-9fd3-53a637fa582d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:24:59.932516 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-22ce0dc8-dac7-4bf7-9fd3-53a637fa582d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:24:59.992232 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-22ce0dc8-dac7-4bf7-9fd3-53a637fa582d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:24:59.999066 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-22ce0dc8-dac7-4bf7-9fd3-53a637fa582d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1237 microversion: 2.1 time: 0.071914 Jun 30 04:24:59.999822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 471/918] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:24:59 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:01.020228 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-39fbbf90-1cc2-4545-8d24-f385c45162cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:01.022479 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-39fbbf90-1cc2-4545-8d24-f385c45162cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:01.033793 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-39fbbf90-1cc2-4545-8d24-f385c45162cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:01.034535 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-39fbbf90-1cc2-4545-8d24-f385c45162cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:01.035864 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-39fbbf90-1cc2-4545-8d24-f385c45162cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:01.036577 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-39fbbf90-1cc2-4545-8d24-f385c45162cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:01.112222 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-39fbbf90-1cc2-4545-8d24-f385c45162cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:01.120716 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-39fbbf90-1cc2-4545-8d24-f385c45162cb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1241 microversion: 2.1 time: 0.107111 Jun 30 04:25:01.121288 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 448/919] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:01 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:02.141048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-50ec448d-d79b-4322-afda-654329e74464 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:02.141639 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-50ec448d-d79b-4322-afda-654329e74464 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:02.148991 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-50ec448d-d79b-4322-afda-654329e74464 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:02.149439 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-50ec448d-d79b-4322-afda-654329e74464 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:02.150212 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-50ec448d-d79b-4322-afda-654329e74464 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:02.150644 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-50ec448d-d79b-4322-afda-654329e74464 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:02.223252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-50ec448d-d79b-4322-afda-654329e74464 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:02.230916 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-50ec448d-d79b-4322-afda-654329e74464 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1295 microversion: 2.1 time: 0.093960 Jun 30 04:25:02.231550 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 472/920] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:02 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:03.057947 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-e6e7a182-b011-43e8-886b-b3f914e6f7ca req-bd41fdaa-1227-490c-bc51-ee37fddf4581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd911f4-5f42-4dc7-8a40-2b62f807a2b1", "tag": "40631800-6072-4fdd-be36-5c02d8b757e9"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:25:03.067053 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-e6e7a182-b011-43e8-886b-b3f914e6f7ca req-bd41fdaa-1227-490c-bc51-ee37fddf4581 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:03.067713 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-e6e7a182-b011-43e8-886b-b3f914e6f7ca req-bd41fdaa-1227-490c-bc51-ee37fddf4581 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:03.085735 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-e6e7a182-b011-43e8-886b-b3f914e6f7ca req-bd41fdaa-1227-490c-bc51-ee37fddf4581 service nova] Creating event network-changed:40631800-6072-4fdd-be36-5c02d8b757e9 for instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 on hv-cinder-84684 Jun 30 04:25:03.097759 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-e6e7a182-b011-43e8-886b-b3f914e6f7ca req-bd41fdaa-1227-490c-bc51-ee37fddf4581 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043453 Jun 30 04:25:03.098460 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 449/921] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:03.248093 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e7323e82-8720-4d43-85f2-2284cd985978 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:03.248676 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e7323e82-8720-4d43-85f2-2284cd985978 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:03.255589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e7323e82-8720-4d43-85f2-2284cd985978 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:03.255751 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e7323e82-8720-4d43-85f2-2284cd985978 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:03.256490 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e7323e82-8720-4d43-85f2-2284cd985978 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:03.256909 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e7323e82-8720-4d43-85f2-2284cd985978 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:03.484757 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e7323e82-8720-4d43-85f2-2284cd985978 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:03.492496 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e7323e82-8720-4d43-85f2-2284cd985978 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1363 microversion: 2.1 time: 0.248273 Jun 30 04:25:03.493056 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 473/922] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:03 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:04.510308 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-76d906f7-eabd-44c2-8769-dba7422ee764 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:04.511062 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-76d906f7-eabd-44c2-8769-dba7422ee764 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:04.517492 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-76d906f7-eabd-44c2-8769-dba7422ee764 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:04.517933 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-76d906f7-eabd-44c2-8769-dba7422ee764 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:04.518688 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-76d906f7-eabd-44c2-8769-dba7422ee764 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:04.519127 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-76d906f7-eabd-44c2-8769-dba7422ee764 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:04.714626 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-76d906f7-eabd-44c2-8769-dba7422ee764 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:04.722425 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-76d906f7-eabd-44c2-8769-dba7422ee764 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1363 microversion: 2.1 time: 0.216946 Jun 30 04:25:04.723042 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 450/923] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:04 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:05.743515 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-e754eaaf-2dec-478e-9885-7641ec8d6658 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:05.744469 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-e754eaaf-2dec-478e-9885-7641ec8d6658 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:05.754359 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e754eaaf-2dec-478e-9885-7641ec8d6658 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:05.755061 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e754eaaf-2dec-478e-9885-7641ec8d6658 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:05.756413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e754eaaf-2dec-478e-9885-7641ec8d6658 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:05.756923 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-e754eaaf-2dec-478e-9885-7641ec8d6658 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:05.904144 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-e754eaaf-2dec-478e-9885-7641ec8d6658 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:05.915685 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-e754eaaf-2dec-478e-9885-7641ec8d6658 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1363 microversion: 2.1 time: 0.178522 Jun 30 04:25:05.916439 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 474/924] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:05 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:06.941503 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-51fbc202-5320-4588-94fc-7e7d92025a5c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:06.942405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-51fbc202-5320-4588-94fc-7e7d92025a5c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:06.950364 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-51fbc202-5320-4588-94fc-7e7d92025a5c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:06.950814 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-51fbc202-5320-4588-94fc-7e7d92025a5c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:06.951617 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-51fbc202-5320-4588-94fc-7e7d92025a5c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:06.952044 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-51fbc202-5320-4588-94fc-7e7d92025a5c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:07.090073 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-51fbc202-5320-4588-94fc-7e7d92025a5c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:07.097772 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-51fbc202-5320-4588-94fc-7e7d92025a5c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1363 microversion: 2.1 time: 0.163065 Jun 30 04:25:07.098356 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 451/925] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:06 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:08.118943 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b012c1d8-c954-4d9b-9166-b3710464066b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:08.119539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b012c1d8-c954-4d9b-9166-b3710464066b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:08.121571 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:25:08.127617 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b012c1d8-c954-4d9b-9166-b3710464066b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:08.128055 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b012c1d8-c954-4d9b-9166-b3710464066b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:08.128814 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b012c1d8-c954-4d9b-9166-b3710464066b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:08.129236 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b012c1d8-c954-4d9b-9166-b3710464066b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:08.297885 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b012c1d8-c954-4d9b-9166-b3710464066b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:08.306554 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b012c1d8-c954-4d9b-9166-b3710464066b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1363 microversion: 2.1 time: 0.193712 Jun 30 04:25:08.307124 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 475/926] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:08 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:08.320335 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-58d64e6d-ac99-450f-8cc9-b9c64c2f89b3 req-eb0a7f24-56d1-425f-a402-29f47464dd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd911f4-5f42-4dc7-8a40-2b62f807a2b1", "name": "network-vif-plugged", "status": "completed", "tag": "40631800-6072-4fdd-be36-5c02d8b757e9"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:25:08.328516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-58d64e6d-ac99-450f-8cc9-b9c64c2f89b3 req-eb0a7f24-56d1-425f-a402-29f47464dd1e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:08.329013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-58d64e6d-ac99-450f-8cc9-b9c64c2f89b3 req-eb0a7f24-56d1-425f-a402-29f47464dd1e service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:08.341670 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-58d64e6d-ac99-450f-8cc9-b9c64c2f89b3 req-eb0a7f24-56d1-425f-a402-29f47464dd1e service nova] Creating event network-vif-plugged:40631800-6072-4fdd-be36-5c02d8b757e9 for instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 on hv-cinder-84684 Jun 30 04:25:08.346737 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-58d64e6d-ac99-450f-8cc9-b9c64c2f89b3 req-eb0a7f24-56d1-425f-a402-29f47464dd1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030874 Jun 30 04:25:08.347378 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 452/927] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:09.324334 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-80da3413-1f1e-417d-99d7-fb25ff6a1b28 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:09.325054 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-80da3413-1f1e-417d-99d7-fb25ff6a1b28 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:09.331913 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-80da3413-1f1e-417d-99d7-fb25ff6a1b28 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:09.332365 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-80da3413-1f1e-417d-99d7-fb25ff6a1b28 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:09.333147 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-80da3413-1f1e-417d-99d7-fb25ff6a1b28 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:09.333582 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-80da3413-1f1e-417d-99d7-fb25ff6a1b28 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:09.474023 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-80da3413-1f1e-417d-99d7-fb25ff6a1b28 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:09.481876 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-80da3413-1f1e-417d-99d7-fb25ff6a1b28 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1363 microversion: 2.1 time: 0.161957 Jun 30 04:25:09.482763 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 476/928] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:09 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:10.496009 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=8 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:25:10.501020 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-289d8859-191b-4827-8cf4-6eeee0c9fa7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:10.501741 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-289d8859-191b-4827-8cf4-6eeee0c9fa7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:10.508287 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-289d8859-191b-4827-8cf4-6eeee0c9fa7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:10.508733 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-289d8859-191b-4827-8cf4-6eeee0c9fa7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:10.509498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-289d8859-191b-4827-8cf4-6eeee0c9fa7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:10.509928 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-289d8859-191b-4827-8cf4-6eeee0c9fa7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:10.645369 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-289d8859-191b-4827-8cf4-6eeee0c9fa7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:10.653456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-289d8859-191b-4827-8cf4-6eeee0c9fa7d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1550 microversion: 2.1 time: 0.158511 Jun 30 04:25:10.654032 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 453/929] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:10 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:10.669873 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d564553f-6ec8-4392-9192-05ccc8b1c9e4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:10.670411 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d564553f-6ec8-4392-9192-05ccc8b1c9e4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:10.672247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=10 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:25:10.678374 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d564553f-6ec8-4392-9192-05ccc8b1c9e4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:10.678822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d564553f-6ec8-4392-9192-05ccc8b1c9e4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:10.679638 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d564553f-6ec8-4392-9192-05ccc8b1c9e4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:10.680053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d564553f-6ec8-4392-9192-05ccc8b1c9e4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:10.766380 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d564553f-6ec8-4392-9192-05ccc8b1c9e4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100481 Jun 30 04:25:10.766982 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 477/930] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 30 04:25:10 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:11.999310 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-4976ca6a-9f93-4556-98d9-1974fce2c687 req-2d36b98b-0219-422b-a1bd-a2380e03707f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd911f4-5f42-4dc7-8a40-2b62f807a2b1", "tag": "40631800-6072-4fdd-be36-5c02d8b757e9"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:25:12.008380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4976ca6a-9f93-4556-98d9-1974fce2c687 req-2d36b98b-0219-422b-a1bd-a2380e03707f service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:12.008899 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4976ca6a-9f93-4556-98d9-1974fce2c687 req-2d36b98b-0219-422b-a1bd-a2380e03707f service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:12.021044 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-4976ca6a-9f93-4556-98d9-1974fce2c687 req-2d36b98b-0219-422b-a1bd-a2380e03707f service nova] Creating event network-changed:40631800-6072-4fdd-be36-5c02d8b757e9 for instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 on hv-cinder-84684 Jun 30 04:25:12.026745 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-4976ca6a-9f93-4556-98d9-1974fce2c687 req-2d36b98b-0219-422b-a1bd-a2380e03707f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031287 Jun 30 04:25:12.027344 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 454/931] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:33.576734 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:25:33.577768 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-cc8d0342-5c9a-454a-8e7c-f2a33ac9107f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:33.578219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=50 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:25:33.578738 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cc8d0342-5c9a-454a-8e7c-f2a33ac9107f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:33.583679 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-32cc624c-cb1a-4a2e-9a6e-85b5c67357cd req-236e9404-0909-4358-8a1f-db5c5229698c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "679b1905-1999-4528-94b5-26d01c3768a5", "tag": "b82a599a-5700-469a-bad4-85ce45d68120"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:25:33.585451 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:25:33.586171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:25:33.588960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cc8d0342-5c9a-454a-8e7c-f2a33ac9107f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:33.588960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cc8d0342-5c9a-454a-8e7c-f2a33ac9107f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:33.588960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cc8d0342-5c9a-454a-8e7c-f2a33ac9107f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:33.589287 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-cc8d0342-5c9a-454a-8e7c-f2a33ac9107f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:33.596874 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-32cc624c-cb1a-4a2e-9a6e-85b5c67357cd req-236e9404-0909-4358-8a1f-db5c5229698c service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:33.597410 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-32cc624c-cb1a-4a2e-9a6e-85b5c67357cd req-236e9404-0909-4358-8a1f-db5c5229698c service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:33.611772 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-32cc624c-cb1a-4a2e-9a6e-85b5c67357cd req-236e9404-0909-4358-8a1f-db5c5229698c service nova] Creating event network-changed:b82a599a-5700-469a-bad4-85ce45d68120 for instance 679b1905-1999-4528-94b5-26d01c3768a5 on hv-cinder-84684 Jun 30 04:25:33.617516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-32cc624c-cb1a-4a2e-9a6e-85b5c67357cd req-236e9404-0909-4358-8a1f-db5c5229698c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042082 Jun 30 04:25:33.618415 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-cc8d0342-5c9a-454a-8e7c-f2a33ac9107f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:25:33.618896 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 455/932] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:33.714453 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-cc8d0342-5c9a-454a-8e7c-f2a33ac9107f tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "DELETE /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 204 len: 0 microversion: 2.1 time: 0.140743 Jun 30 04:25:33.718825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 478/933] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:25:33 2022] DELETE /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:25:33.725145 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6a977b18-215b-4b98-a9c3-d93aa4278034 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:33.725840 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6a977b18-215b-4b98-a9c3-d93aa4278034 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:33.732368 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a977b18-215b-4b98-a9c3-d93aa4278034 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:33.732812 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a977b18-215b-4b98-a9c3-d93aa4278034 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:33.733598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a977b18-215b-4b98-a9c3-d93aa4278034 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:33.734029 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a977b18-215b-4b98-a9c3-d93aa4278034 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:33.995911 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6a977b18-215b-4b98-a9c3-d93aa4278034 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:34.004457 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6a977b18-215b-4b98-a9c3-d93aa4278034 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1576 microversion: 2.1 time: 0.283869 Jun 30 04:25:34.005025 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 456/934] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:33 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1576 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:35.023212 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-66fd034c-8f09-4da4-9844-b752208f7a97 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:35.024563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-66fd034c-8f09-4da4-9844-b752208f7a97 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:35.032446 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-66fd034c-8f09-4da4-9844-b752208f7a97 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:35.032986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-66fd034c-8f09-4da4-9844-b752208f7a97 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:35.033874 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-66fd034c-8f09-4da4-9844-b752208f7a97 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:35.034291 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-66fd034c-8f09-4da4-9844-b752208f7a97 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:35.305894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-66fd034c-8f09-4da4-9844-b752208f7a97 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:35.314899 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-66fd034c-8f09-4da4-9844-b752208f7a97 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1576 microversion: 2.1 time: 0.296292 Jun 30 04:25:35.315531 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 479/935] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:35 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1576 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:35.890771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-732b2acd-536c-49e8-ae58-9041665d12fa req-68060496-cd6f-47fb-b22b-5d50cd359b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679b1905-1999-4528-94b5-26d01c3768a5", "name": "network-vif-deleted", "tag": "b82a599a-5700-469a-bad4-85ce45d68120"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:25:35.902617 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-732b2acd-536c-49e8-ae58-9041665d12fa req-68060496-cd6f-47fb-b22b-5d50cd359b90 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:35.903182 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-732b2acd-536c-49e8-ae58-9041665d12fa req-68060496-cd6f-47fb-b22b-5d50cd359b90 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:35.915070 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-732b2acd-536c-49e8-ae58-9041665d12fa req-68060496-cd6f-47fb-b22b-5d50cd359b90 service nova] Creating event network-vif-deleted:b82a599a-5700-469a-bad4-85ce45d68120 for instance 679b1905-1999-4528-94b5-26d01c3768a5 on hv-cinder-84684 Jun 30 04:25:35.920496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-732b2acd-536c-49e8-ae58-9041665d12fa req-68060496-cd6f-47fb-b22b-5d50cd359b90 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035382 Jun 30 04:25:35.921125 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 457/936] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:36.332362 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:36.332949 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:36.339988 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:36.340627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:36.341389 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:36.341819 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:36.373153 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:36.373592 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:36.374032 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lazy-loading 'fault' on Instance uuid 679b1905-1999-4528-94b5-26d01c3768a5 {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:25:36.418523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:36.426691 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f120d4e4-ee7e-4d32-8eb1-623221ce2592 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 200 len: 1230 microversion: 2.1 time: 0.098408 Jun 30 04:25:36.427296 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 480/937] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:36 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:37.445480 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-aba67ba1-c878-4f45-be0b-4a9492ccab65 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:37.446176 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-aba67ba1-c878-4f45-be0b-4a9492ccab65 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 679b1905-1999-4528-94b5-26d01c3768a5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:37.452915 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aba67ba1-c878-4f45-be0b-4a9492ccab65 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:37.453357 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aba67ba1-c878-4f45-be0b-4a9492ccab65 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:37.454100 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aba67ba1-c878-4f45-be0b-4a9492ccab65 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:37.454527 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aba67ba1-c878-4f45-be0b-4a9492ccab65 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:37.467912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-aba67ba1-c878-4f45-be0b-4a9492ccab65 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] HTTP exception thrown: Instance 679b1905-1999-4528-94b5-26d01c3768a5 could not be found. Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-aba67ba1-c878-4f45-be0b-4a9492ccab65 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Request method failure captured: Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 HTTP/1.1 Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSPnkigjnICry9tM5IK-uZJQXEazf1odAxsmL38Fj4dgwtESFU0i5J8hq0xkuumOp_ij-eqSifPqeh5PTqBWPfYzWUAGPU3zWVRQzyGieu3Kz42aahhmGZ--CD5kgVDx7UDnKBVhfNmEZGab-LnN1-GDn8peSa2JNWp_IGHVZKr8MlM Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: c2fe0f4b2519494ea784cea098da6be3 Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:25:37.469530 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c2fe0f4b2519494ea784cea098da6be3"}]}] Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: c2fe0f4b2519494ea784cea098da6be3 Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-TestVolumeBootPattern-1718480899-project Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: e269c6a656ff4721911ae25657eeedca Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-TestVolumeBootPattern-1718480899-project Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 679b1905-1999-4528-94b5-26d01c3768a5 could not be found. Jun 30 04:25:37.471773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '679b1905-1999-4528-94b5-26d01c3768a5'} Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 679b1905-1999-4528-94b5-26d01c3768a5 could not be found. Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:25:37.472572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 679b1905-1999-4528-94b5-26d01c3768a5 could not be found. Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 679b1905-1999-4528-94b5-26d01c3768a5 could not be found. Jun 30 04:25:37.473957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:37.475243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-aba67ba1-c878-4f45-be0b-4a9492ccab65 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Returning 404 to user: Instance 679b1905-1999-4528-94b5-26d01c3768a5 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:25:37.475243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-aba67ba1-c878-4f45-be0b-4a9492ccab65 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5" status: 404 len: 111 microversion: 2.1 time: 0.030202 Jun 30 04:25:37.475243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 458/938] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:37 2022] GET /compute/v2.1/servers/679b1905-1999-4528-94b5-26d01c3768a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:25:40.776633 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1ea9ca48-df93-484f-916f-059024976607 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:40.777137 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1ea9ca48-df93-484f-916f-059024976607 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:40.784545 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1ea9ca48-df93-484f-916f-059024976607 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:40.784994 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1ea9ca48-df93-484f-916f-059024976607 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:40.785296 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-da5c21f1-6708-4930-808e-8cf8621ef6c2 req-e55af7e2-5a01-4bd7-acbc-9e82b4ea8902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "997a86f0-800e-427c-91a4-9c6a7c8f7fff", "tag": "231a2e75-10e5-4ba7-b633-e79d395e40f4"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:25:40.785764 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1ea9ca48-df93-484f-916f-059024976607 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:40.786209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1ea9ca48-df93-484f-916f-059024976607 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:40.794648 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-da5c21f1-6708-4930-808e-8cf8621ef6c2 req-e55af7e2-5a01-4bd7-acbc-9e82b4ea8902 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:40.795065 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-da5c21f1-6708-4930-808e-8cf8621ef6c2 req-e55af7e2-5a01-4bd7-acbc-9e82b4ea8902 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:40.806799 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-da5c21f1-6708-4930-808e-8cf8621ef6c2 req-e55af7e2-5a01-4bd7-acbc-9e82b4ea8902 service nova] Creating event network-changed:231a2e75-10e5-4ba7-b633-e79d395e40f4 for instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff on hv-cinder-84684 Jun 30 04:25:40.811740 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-da5c21f1-6708-4930-808e-8cf8621ef6c2 req-e55af7e2-5a01-4bd7-acbc-9e82b4ea8902 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030096 Jun 30 04:25:40.812612 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 459/939] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:40.814259 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1ea9ca48-df93-484f-916f-059024976607 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:25:40.910252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1ea9ca48-df93-484f-916f-059024976607 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "DELETE /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 204 len: 0 microversion: 2.1 time: 0.137769 Jun 30 04:25:40.910843 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 481/940] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:25:40 2022] DELETE /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:25:40.919654 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f0b87434-3cfc-4fd0-b7f1-5e44d5eb1830 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:40.920378 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f0b87434-3cfc-4fd0-b7f1-5e44d5eb1830 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:40.927584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f0b87434-3cfc-4fd0-b7f1-5e44d5eb1830 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:40.928027 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f0b87434-3cfc-4fd0-b7f1-5e44d5eb1830 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:40.928777 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f0b87434-3cfc-4fd0-b7f1-5e44d5eb1830 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:40.929386 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f0b87434-3cfc-4fd0-b7f1-5e44d5eb1830 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:41.069600 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f0b87434-3cfc-4fd0-b7f1-5e44d5eb1830 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:41.077468 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f0b87434-3cfc-4fd0-b7f1-5e44d5eb1830 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1576 microversion: 2.1 time: 0.162010 Jun 30 04:25:41.078031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 460/941] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:40 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:42.099521 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6df76aea-5b38-4965-8094-adf0daf1ec16 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:42.100393 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6df76aea-5b38-4965-8094-adf0daf1ec16 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:42.107993 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6df76aea-5b38-4965-8094-adf0daf1ec16 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:42.108557 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6df76aea-5b38-4965-8094-adf0daf1ec16 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:42.109482 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6df76aea-5b38-4965-8094-adf0daf1ec16 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:42.110009 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6df76aea-5b38-4965-8094-adf0daf1ec16 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:42.289074 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-6df76aea-5b38-4965-8094-adf0daf1ec16 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:42.301145 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6df76aea-5b38-4965-8094-adf0daf1ec16 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1576 microversion: 2.1 time: 0.208576 Jun 30 04:25:42.301721 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 482/942] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:42 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:42.982230 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-7ba25028-7508-43d3-85b1-8dbaa9a50efd req-abe7427d-086a-4fed-a435-a4ecc7aa13a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "997a86f0-800e-427c-91a4-9c6a7c8f7fff", "name": "network-vif-deleted", "tag": "231a2e75-10e5-4ba7-b633-e79d395e40f4"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:25:42.991297 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-7ba25028-7508-43d3-85b1-8dbaa9a50efd req-abe7427d-086a-4fed-a435-a4ecc7aa13a4 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:42.991738 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-7ba25028-7508-43d3-85b1-8dbaa9a50efd req-abe7427d-086a-4fed-a435-a4ecc7aa13a4 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:43.004238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-7ba25028-7508-43d3-85b1-8dbaa9a50efd req-abe7427d-086a-4fed-a435-a4ecc7aa13a4 service nova] Creating event network-vif-deleted:231a2e75-10e5-4ba7-b633-e79d395e40f4 for instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff on hv-cinder-84684 Jun 30 04:25:43.010321 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-7ba25028-7508-43d3-85b1-8dbaa9a50efd req-abe7427d-086a-4fed-a435-a4ecc7aa13a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Jun 30 04:25:43.011210 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 461/943] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:43.318809 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:43.319601 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:43.326604 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:43.327205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:43.327986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:43.328416 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:43.361206 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:43.361626 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:43.362073 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lazy-loading 'fault' on Instance uuid 997a86f0-800e-427c-91a4-9c6a7c8f7fff {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:25:43.406187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e269c6a656ff4721911ae25657eeedca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2fe0f4b2519494ea784cea098da6be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:25:43.414455 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0b311d4c-46f3-4a42-a815-5b4b93db6fc5 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 200 len: 1230 microversion: 2.1 time: 0.099861 Jun 30 04:25:43.415019 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 483/944] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:43 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:25:44.438466 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0322392b-3559-44aa-b82e-823646aeea30 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:44.439659 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0322392b-3559-44aa-b82e-823646aeea30 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: 997a86f0-800e-427c-91a4-9c6a7c8f7fff] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:44.447999 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0322392b-3559-44aa-b82e-823646aeea30 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:44.448450 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0322392b-3559-44aa-b82e-823646aeea30 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:44.449218 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0322392b-3559-44aa-b82e-823646aeea30 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:44.449681 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0322392b-3559-44aa-b82e-823646aeea30 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:44.463363 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-0322392b-3559-44aa-b82e-823646aeea30 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] HTTP exception thrown: Instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff could not be found. Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0322392b-3559-44aa-b82e-823646aeea30 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Request method failure captured: Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff HTTP/1.1 Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSPnkigjnICry9tM5IK-uZJQXEazf1odAxsmL38Fj4dgwtESFU0i5J8hq0xkuumOp_ij-eqSifPqeh5PTqBWPfYzWUAGPU3zWVRQzyGieu3Kz42aahhmGZ--CD5kgVDx7UDnKBVhfNmEZGab-LnN1-GDn8peSa2JNWp_IGHVZKr8MlM Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: c2fe0f4b2519494ea784cea098da6be3 Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:25:44.464975 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c2fe0f4b2519494ea784cea098da6be3"}]}] Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: c2fe0f4b2519494ea784cea098da6be3 Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-TestVolumeBootPattern-1718480899-project Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: e269c6a656ff4721911ae25657eeedca Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-TestVolumeBootPattern-1718480899-project Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff could not be found. Jun 30 04:25:44.466532 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '997a86f0-800e-427c-91a4-9c6a7c8f7fff'} Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff could not be found. Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:25:44.467456 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff could not be found. Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff could not be found. Jun 30 04:25:44.468918 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.470229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0322392b-3559-44aa-b82e-823646aeea30 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Returning 404 to user: Instance 997a86f0-800e-427c-91a4-9c6a7c8f7fff could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:25:44.470229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0322392b-3559-44aa-b82e-823646aeea30 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff" status: 404 len: 111 microversion: 2.1 time: 0.035152 Jun 30 04:25:44.470229 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 462/945] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:44 2022] GET /compute/v2.1/servers/997a86f0-800e-427c-91a4-9c6a7c8f7fff => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:25:44.919589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3783e471-91eb-4c9d-89d9-a5724add1124 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:44.920115 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3783e471-91eb-4c9d-89d9-a5724add1124 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:44.927198 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3783e471-91eb-4c9d-89d9-a5724add1124 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:44.927646 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3783e471-91eb-4c9d-89d9-a5724add1124 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:44.928404 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3783e471-91eb-4c9d-89d9-a5724add1124 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:44.928831 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3783e471-91eb-4c9d-89d9-a5724add1124 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:44.942048 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-3783e471-91eb-4c9d-89d9-a5724add1124 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] HTTP exception thrown: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3783e471-91eb-4c9d-89d9-a5724add1124 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Request method failure captured: Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: DELETE /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f HTTP/1.1 Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSPnkigjnICry9tM5IK-uZJQXEazf1odAxsmL38Fj4dgwtESFU0i5J8hq0xkuumOp_ij-eqSifPqeh5PTqBWPfYzWUAGPU3zWVRQzyGieu3Kz42aahhmGZ--CD5kgVDx7UDnKBVhfNmEZGab-LnN1-GDn8peSa2JNWp_IGHVZKr8MlM Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: c2fe0f4b2519494ea784cea098da6be3 Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:25:44.943825 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c2fe0f4b2519494ea784cea098da6be3"}]}] Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: c2fe0f4b2519494ea784cea098da6be3 Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-TestVolumeBootPattern-1718480899-project Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: e269c6a656ff4721911ae25657eeedca Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-TestVolumeBootPattern-1718480899-project Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:25:44.945354 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': 'd0a0dbf7-3345-49a9-9785-a36af6da4a5f'} Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:25:44.946414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:25:44.947986 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.949529 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3783e471-91eb-4c9d-89d9-a5724add1124 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Returning 404 to user: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:25:44.949529 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3783e471-91eb-4c9d-89d9-a5724add1124 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 404 len: 111 microversion: 2.1 time: 0.029605 Jun 30 04:25:44.949529 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 484/946] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:25:44 2022] DELETE /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:25:44.953785 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-558340f3-bd17-4156-876b-cf09c850d9f2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:44.954371 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-558340f3-bd17-4156-876b-cf09c850d9f2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] [instance: d0a0dbf7-3345-49a9-9785-a36af6da4a5f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:44.960556 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-558340f3-bd17-4156-876b-cf09c850d9f2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:44.961001 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-558340f3-bd17-4156-876b-cf09c850d9f2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:44.961763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-558340f3-bd17-4156-876b-cf09c850d9f2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:44.962196 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-558340f3-bd17-4156-876b-cf09c850d9f2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:44.975790 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-558340f3-bd17-4156-876b-cf09c850d9f2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] HTTP exception thrown: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-558340f3-bd17-4156-876b-cf09c850d9f2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Request method failure captured: Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f HTTP/1.1 Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSPnkigjnICry9tM5IK-uZJQXEazf1odAxsmL38Fj4dgwtESFU0i5J8hq0xkuumOp_ij-eqSifPqeh5PTqBWPfYzWUAGPU3zWVRQzyGieu3Kz42aahhmGZ--CD5kgVDx7UDnKBVhfNmEZGab-LnN1-GDn8peSa2JNWp_IGHVZKr8MlM Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: c2fe0f4b2519494ea784cea098da6be3 Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:25:44.977291 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2fe0f4b2519494ea784cea098da6be3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c2fe0f4b2519494ea784cea098da6be3"}]}] Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: c2fe0f4b2519494ea784cea098da6be3 Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-TestVolumeBootPattern-1718480899 Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-TestVolumeBootPattern-1718480899-project Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: e269c6a656ff4721911ae25657eeedca Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-TestVolumeBootPattern-1718480899-project Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:25:44.978882 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': 'd0a0dbf7-3345-49a9-9785-a36af6da4a5f'} Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:25:44.979816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. Jun 30 04:25:44.981373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:25:44.982727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-558340f3-bd17-4156-876b-cf09c850d9f2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Returning 404 to user: Instance d0a0dbf7-3345-49a9-9785-a36af6da4a5f could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:25:44.982727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-558340f3-bd17-4156-876b-cf09c850d9f2 tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f" status: 404 len: 111 microversion: 2.1 time: 0.028774 Jun 30 04:25:44.982727 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 463/947] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:25:44 2022] GET /compute/v2.1/servers/d0a0dbf7-3345-49a9-9785-a36af6da4a5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:25:45.806653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c551d6ed-8527-4c78-926f-cf60d41250c4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:45.807124 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c551d6ed-8527-4c78-926f-cf60d41250c4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:45.813622 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c551d6ed-8527-4c78-926f-cf60d41250c4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:45.814057 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c551d6ed-8527-4c78-926f-cf60d41250c4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:45.814807 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c551d6ed-8527-4c78-926f-cf60d41250c4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:45.815273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c551d6ed-8527-4c78-926f-cf60d41250c4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:45.839481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c551d6ed-8527-4c78-926f-cf60d41250c4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/ips" status: 200 len: 147 microversion: 2.1 time: 0.037421 Jun 30 04:25:45.839960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 485/948] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 30 04:25:45 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:46.270373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f0ca8df3-5ce8-4b4f-99e7-3722bf2eb9ad tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] Calling method '.version_select at 0x7fb4801d4160>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:46.291445 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f0ca8df3-5ce8-4b4f-99e7-3722bf2eb9ad tempest-TestVolumeBootPattern-1718480899 tempest-TestVolumeBootPattern-1718480899-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-814051584" status: 202 len: 0 microversion: 2.1 time: 0.024820 Jun 30 04:25:46.292145 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 464/949] 10.222.0.13 () {58 vars in 1259 bytes} [Thu Jun 30 04:25:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-814051584 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:25:47.176894 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-87b90185-cac7-4b6b-98d8-e1bb8cdb7006 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a9acd63-e1a7-4b63-a94b-8ea56abdb52e"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:25:47.178081 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-87b90185-cac7-4b6b-98d8-e1bb8cdb7006 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:47.184824 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-87b90185-cac7-4b6b-98d8-e1bb8cdb7006 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:47.185277 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-87b90185-cac7-4b6b-98d8-e1bb8cdb7006 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:47.186041 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-87b90185-cac7-4b6b-98d8-e1bb8cdb7006 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:47.186480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-87b90185-cac7-4b6b-98d8-e1bb8cdb7006 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:47.464178 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-87b90185-cac7-4b6b-98d8-e1bb8cdb7006 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291043 Jun 30 04:25:47.464808 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 486/950] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:25:47 2022] POST /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:53.959210 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-53ba9d65-23e6-4dea-9242-c33582c84e56 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:53.960254 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-53ba9d65-23e6-4dea-9242-c33582c84e56 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:53.968306 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53ba9d65-23e6-4dea-9242-c33582c84e56 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:53.971771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53ba9d65-23e6-4dea-9242-c33582c84e56 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:53.971771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53ba9d65-23e6-4dea-9242-c33582c84e56 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:53.971771 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53ba9d65-23e6-4dea-9242-c33582c84e56 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:54.001945 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-53ba9d65-23e6-4dea-9242-c33582c84e56 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047751 Jun 30 04:25:54.002633 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 465/951] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:25:53 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:54.018452 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0dadcfe3-4bfd-4bf5-8474-4c5853e4c36e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:25:54.019050 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0dadcfe3-4bfd-4bf5-8474-4c5853e4c36e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:54.026667 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dadcfe3-4bfd-4bf5-8474-4c5853e4c36e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:54.027136 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dadcfe3-4bfd-4bf5-8474-4c5853e4c36e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:54.027941 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dadcfe3-4bfd-4bf5-8474-4c5853e4c36e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:54.028344 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0dadcfe3-4bfd-4bf5-8474-4c5853e4c36e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:54.058845 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0dadcfe3-4bfd-4bf5-8474-4c5853e4c36e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments/2a9acd63-e1a7-4b63-a94b-8ea56abdb52e" status: 200 len: 194 microversion: 2.1 time: 0.047280 Jun 30 04:25:54.059479 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 487/952] 10.222.0.13 () {58 vars in 1412 bytes} [Thu Jun 30 04:25:54 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments/2a9acd63-e1a7-4b63-a94b-8ea56abdb52e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:25:55.400725 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fb836a1e-5ee5-40b7-85f0-b25d25c6283e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39cba82c-2089-4dac-979f-17efaed0459d"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:25:55.401773 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fb836a1e-5ee5-40b7-85f0-b25d25c6283e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:25:55.409154 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb836a1e-5ee5-40b7-85f0-b25d25c6283e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:55.409595 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb836a1e-5ee5-40b7-85f0-b25d25c6283e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:55.410348 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb836a1e-5ee5-40b7-85f0-b25d25c6283e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:25:55.410778 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb836a1e-5ee5-40b7-85f0-b25d25c6283e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:25:55.678410 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fb836a1e-5ee5-40b7-85f0-b25d25c6283e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "POST /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281625 Jun 30 04:25:55.679383 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 466/953] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:25:55 2022] POST /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:26:02.177896 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-311a13fc-fcd0-4017-b001-28bfd8d7adb8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:02.179263 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-311a13fc-fcd0-4017-b001-28bfd8d7adb8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:02.186194 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-311a13fc-fcd0-4017-b001-28bfd8d7adb8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:02.186637 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-311a13fc-fcd0-4017-b001-28bfd8d7adb8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:02.187462 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-311a13fc-fcd0-4017-b001-28bfd8d7adb8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:02.187878 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-311a13fc-fcd0-4017-b001-28bfd8d7adb8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:02.218080 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-311a13fc-fcd0-4017-b001-28bfd8d7adb8 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046592 Jun 30 04:26:02.218630 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 488/954] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:26:02 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:26:02.368555 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d0781184-4f76-4ce2-b2f7-f860e94e467e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:02.369167 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d0781184-4f76-4ce2-b2f7-f860e94e467e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:02.376003 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d0781184-4f76-4ce2-b2f7-f860e94e467e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:02.376453 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d0781184-4f76-4ce2-b2f7-f860e94e467e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:02.377220 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d0781184-4f76-4ce2-b2f7-f860e94e467e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:02.377645 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d0781184-4f76-4ce2-b2f7-f860e94e467e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:02.407022 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d0781184-4f76-4ce2-b2f7-f860e94e467e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments/2a9acd63-e1a7-4b63-a94b-8ea56abdb52e" status: 200 len: 194 microversion: 2.1 time: 0.045715 Jun 30 04:26:02.407637 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 467/955] 10.222.0.13 () {58 vars in 1412 bytes} [Thu Jun 30 04:26:02 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments/2a9acd63-e1a7-4b63-a94b-8ea56abdb52e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:26:02.417711 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-dfb68011-68f1-47b4-874e-14fb7c3f504b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:02.418205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-dfb68011-68f1-47b4-874e-14fb7c3f504b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:02.425473 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dfb68011-68f1-47b4-874e-14fb7c3f504b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:02.425909 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dfb68011-68f1-47b4-874e-14fb7c3f504b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:02.426661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dfb68011-68f1-47b4-874e-14fb7c3f504b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:02.427090 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dfb68011-68f1-47b4-874e-14fb7c3f504b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:02.512042 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-dfb68011-68f1-47b4-874e-14fb7c3f504b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lazy-loading 'services' on Instance uuid 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:26:02.515587 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:02.745958 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-dfb68011-68f1-47b4-874e-14fb7c3f504b tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments/2a9acd63-e1a7-4b63-a94b-8ea56abdb52e" status: 202 len: 0 microversion: 2.1 time: 0.332258 Jun 30 04:26:02.746699 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 489/956] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:26:02 2022] DELETE /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments/2a9acd63-e1a7-4b63-a94b-8ea56abdb52e => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:26:03.872589 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3a029004-271f-4b99-aa02-66529f5773d4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:03.873142 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3a029004-271f-4b99-aa02-66529f5773d4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:03.875531 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:03.884123 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3a029004-271f-4b99-aa02-66529f5773d4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:03.884708 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3a029004-271f-4b99-aa02-66529f5773d4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:03.885919 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3a029004-271f-4b99-aa02-66529f5773d4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:03.886576 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3a029004-271f-4b99-aa02-66529f5773d4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:03.891406 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:03.922121 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3a029004-271f-4b99-aa02-66529f5773d4 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments/39cba82c-2089-4dac-979f-17efaed0459d" status: 200 len: 194 microversion: 2.1 time: 0.053494 Jun 30 04:26:03.922702 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 468/957] 10.222.0.13 () {58 vars in 1412 bytes} [Thu Jun 30 04:26:03 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments/39cba82c-2089-4dac-979f-17efaed0459d => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:26:03.933756 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1a2cc96a-0057-4e71-a34e-162e74bd40af tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:03.934327 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1a2cc96a-0057-4e71-a34e-162e74bd40af tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:03.936334 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:03.942087 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a2cc96a-0057-4e71-a34e-162e74bd40af tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:03.942533 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a2cc96a-0057-4e71-a34e-162e74bd40af tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:03.943315 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a2cc96a-0057-4e71-a34e-162e74bd40af tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:03.943747 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a2cc96a-0057-4e71-a34e-162e74bd40af tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:04.025275 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-1a2cc96a-0057-4e71-a34e-162e74bd40af tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lazy-loading 'services' on Instance uuid 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:26:04.104301 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1a2cc96a-0057-4e71-a34e-162e74bd40af tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments/39cba82c-2089-4dac-979f-17efaed0459d" status: 202 len: 0 microversion: 2.1 time: 0.175101 Jun 30 04:26:04.104781 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 490/958] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:26:03 2022] DELETE /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments/39cba82c-2089-4dac-979f-17efaed0459d => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:26:05.280014 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ddd18924-8f22-4bcd-bd5c-2836da425159 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:05.280948 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ddd18924-8f22-4bcd-bd5c-2836da425159 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:05.287834 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ddd18924-8f22-4bcd-bd5c-2836da425159 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:05.288285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ddd18924-8f22-4bcd-bd5c-2836da425159 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:05.289081 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ddd18924-8f22-4bcd-bd5c-2836da425159 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:05.289514 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ddd18924-8f22-4bcd-bd5c-2836da425159 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:05.318390 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ddd18924-8f22-4bcd-bd5c-2836da425159 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042359 Jun 30 04:26:05.318946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 469/959] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:26:05 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 04:26:05.432468 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a6bb1d85-b461-41f5-92e4-289a45513a8f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:05.433481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a6bb1d85-b461-41f5-92e4-289a45513a8f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:05.439944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6bb1d85-b461-41f5-92e4-289a45513a8f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:05.440389 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6bb1d85-b461-41f5-92e4-289a45513a8f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:05.441157 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6bb1d85-b461-41f5-92e4-289a45513a8f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:05.441591 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a6bb1d85-b461-41f5-92e4-289a45513a8f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:05.471441 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a6bb1d85-b461-41f5-92e4-289a45513a8f tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045094 Jun 30 04:26:05.471983 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 491/960] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:26:05 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 30 04:26:05.534001 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4e4b7b17-5d82-4b93-9103-fa98b5742d4a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:05.534713 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4e4b7b17-5d82-4b93-9103-fa98b5742d4a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:05.542816 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4e4b7b17-5d82-4b93-9103-fa98b5742d4a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:05.543270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4e4b7b17-5d82-4b93-9103-fa98b5742d4a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:05.544029 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4e4b7b17-5d82-4b93-9103-fa98b5742d4a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:05.544496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4e4b7b17-5d82-4b93-9103-fa98b5742d4a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:05.569513 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4e4b7b17-5d82-4b93-9103-fa98b5742d4a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:26:05.652047 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4e4b7b17-5d82-4b93-9103-fa98b5742d4a tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 204 len: 0 microversion: 2.1 time: 0.124045 Jun 30 04:26:05.652641 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 470/961] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:26:05 2022] DELETE /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:26:05.661329 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f336e903-1526-4ffc-a7fa-3426df9348b1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:05.661967 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f336e903-1526-4ffc-a7fa-3426df9348b1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:05.668791 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f336e903-1526-4ffc-a7fa-3426df9348b1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:05.669171 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f336e903-1526-4ffc-a7fa-3426df9348b1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:05.669914 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f336e903-1526-4ffc-a7fa-3426df9348b1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:05.670341 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f336e903-1526-4ffc-a7fa-3426df9348b1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:05.830634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-f336e903-1526-4ffc-a7fa-3426df9348b1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:05.840408 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f336e903-1526-4ffc-a7fa-3426df9348b1 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1675 microversion: 2.1 time: 0.183029 Jun 30 04:26:05.840994 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 492/962] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:05 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:06.865411 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ddc56057-38f3-4420-8870-f98198442920 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:06.866104 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ddc56057-38f3-4420-8870-f98198442920 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:06.873650 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ddc56057-38f3-4420-8870-f98198442920 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:06.874097 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ddc56057-38f3-4420-8870-f98198442920 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:06.874861 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ddc56057-38f3-4420-8870-f98198442920 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:06.875335 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ddc56057-38f3-4420-8870-f98198442920 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:07.019847 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ddc56057-38f3-4420-8870-f98198442920 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:07.032170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ddc56057-38f3-4420-8870-f98198442920 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1675 microversion: 2.1 time: 0.172747 Jun 30 04:26:07.033063 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 471/963] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:06 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:08.052358 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4236a5a8-5603-4aa5-8eb2-d60fdf245f81 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:08.052948 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4236a5a8-5603-4aa5-8eb2-d60fdf245f81 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:08.060726 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4236a5a8-5603-4aa5-8eb2-d60fdf245f81 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:08.061184 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4236a5a8-5603-4aa5-8eb2-d60fdf245f81 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:08.061962 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4236a5a8-5603-4aa5-8eb2-d60fdf245f81 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:08.062400 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4236a5a8-5603-4aa5-8eb2-d60fdf245f81 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:08.248495 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-4236a5a8-5603-4aa5-8eb2-d60fdf245f81 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a432229e175149b0bc254f19af8007fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec258de3eea4a12a7bd9b2b9832dce6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:08.258320 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4236a5a8-5603-4aa5-8eb2-d60fdf245f81 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 200 len: 1607 microversion: 2.1 time: 0.209886 Jun 30 04:26:08.259786 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 493/964] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:08 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 1607 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:08.668567 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-44024578-8fa8-44c3-9bdb-63e98eed9a12 req-acb0d13c-eedb-466d-afda-0ce320f26ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd911f4-5f42-4dc7-8a40-2b62f807a2b1", "name": "network-vif-deleted", "tag": "40631800-6072-4fdd-be36-5c02d8b757e9"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:26:08.676677 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-44024578-8fa8-44c3-9bdb-63e98eed9a12 req-acb0d13c-eedb-466d-afda-0ce320f26ca1 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:08.677114 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-44024578-8fa8-44c3-9bdb-63e98eed9a12 req-acb0d13c-eedb-466d-afda-0ce320f26ca1 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:08.688452 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-44024578-8fa8-44c3-9bdb-63e98eed9a12 req-acb0d13c-eedb-466d-afda-0ce320f26ca1 service nova] Creating event network-vif-deleted:40631800-6072-4fdd-be36-5c02d8b757e9 for instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 on hv-cinder-84684 Jun 30 04:26:08.693371 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-44024578-8fa8-44c3-9bdb-63e98eed9a12 req-acb0d13c-eedb-466d-afda-0ce320f26ca1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244179 Jun 30 04:26:08.693968 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 472/965] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:26:09.276765 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7a23a1ca-421f-40bf-b82b-5e29e5944beb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:09.277393 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7a23a1ca-421f-40bf-b82b-5e29e5944beb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:09.284656 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7a23a1ca-421f-40bf-b82b-5e29e5944beb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:09.285078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7a23a1ca-421f-40bf-b82b-5e29e5944beb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:09.285899 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7a23a1ca-421f-40bf-b82b-5e29e5944beb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:09.286408 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7a23a1ca-421f-40bf-b82b-5e29e5944beb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-7a23a1ca-421f-40bf-b82b-5e29e5944beb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] HTTP exception thrown: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7a23a1ca-421f-40bf-b82b-5e29e5944beb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Request method failure captured: Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 HTTP/1.1 Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSTl_w5qmBIAWUgXumxbrVIN3UaosrqJIrLTjomDKY_UjsEd0Z82KaVZxFKyu-R15kkUOCiB_qQPa25LHQo7FqgOBKOFu-GN9r6TW593MrcCbijMHvGf04DcyKXBwKq90KIvuxf_z7VQwUZsQj6GziXCT4w8Zz-LaeTjsaCA_XWwCWg Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:26:09.304089 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cec258de3eea4a12a7bd9b2b9832dce6"}]}] Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: a432229e175149b0bc254f19af8007fa Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:09.306095 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '2dd911f4-5f42-4dc7-8a40-2b62f807a2b1'} Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:26:09.306930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:09.308478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:09.309856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7a23a1ca-421f-40bf-b82b-5e29e5944beb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Returning 404 to user: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:26:09.309856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7a23a1ca-421f-40bf-b82b-5e29e5944beb tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 404 len: 111 microversion: 2.1 time: 0.032157 Jun 30 04:26:09.309856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 494/966] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:09 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:26:09.315026 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ae5f34c2-ab38-4209-8511-355f478c247d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '.version_select at 0x7fb4800538b0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:09.334857 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ae5f34c2-ab38-4209-8511-355f478c247d tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1432420252" status: 202 len: 0 microversion: 2.1 time: 0.023703 Jun 30 04:26:09.335333 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 473/967] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 30 04:26:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1432420252 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:26:12.523928 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1a8f7e15-ccc0-46d8-96ca-e78501bb2448 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:12.524455 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1a8f7e15-ccc0-46d8-96ca-e78501bb2448 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:12.531297 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a8f7e15-ccc0-46d8-96ca-e78501bb2448 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:12.531750 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a8f7e15-ccc0-46d8-96ca-e78501bb2448 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:12.532510 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a8f7e15-ccc0-46d8-96ca-e78501bb2448 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:12.532945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1a8f7e15-ccc0-46d8-96ca-e78501bb2448 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:12.546545 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-1a8f7e15-ccc0-46d8-96ca-e78501bb2448 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] HTTP exception thrown: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1a8f7e15-ccc0-46d8-96ca-e78501bb2448 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Request method failure captured: Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: DELETE /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 HTTP/1.1 Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSTl_w5qmBIAWUgXumxbrVIN3UaosrqJIrLTjomDKY_UjsEd0Z82KaVZxFKyu-R15kkUOCiB_qQPa25LHQo7FqgOBKOFu-GN9r6TW593MrcCbijMHvGf04DcyKXBwKq90KIvuxf_z7VQwUZsQj6GziXCT4w8Zz-LaeTjsaCA_XWwCWg Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:26:12.548123 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cec258de3eea4a12a7bd9b2b9832dce6"}]}] Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: a432229e175149b0bc254f19af8007fa Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:12.549563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '2dd911f4-5f42-4dc7-8a40-2b62f807a2b1'} Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:26:12.550399 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:12.551929 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:12.553602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1a8f7e15-ccc0-46d8-96ca-e78501bb2448 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Returning 404 to user: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:26:12.553602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1a8f7e15-ccc0-46d8-96ca-e78501bb2448 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 404 len: 111 microversion: 2.1 time: 0.030131 Jun 30 04:26:12.553602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 495/968] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:26:12 2022] DELETE /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:26:12.562255 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8437eb83-cd12-4dba-98f7-d9ca0299733c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:12.562986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8437eb83-cd12-4dba-98f7-d9ca0299733c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:12.570002 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8437eb83-cd12-4dba-98f7-d9ca0299733c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:12.570498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8437eb83-cd12-4dba-98f7-d9ca0299733c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:12.571707 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8437eb83-cd12-4dba-98f7-d9ca0299733c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:12.572140 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8437eb83-cd12-4dba-98f7-d9ca0299733c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:12.585994 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-8437eb83-cd12-4dba-98f7-d9ca0299733c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] HTTP exception thrown: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8437eb83-cd12-4dba-98f7-d9ca0299733c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Request method failure captured: Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 HTTP/1.1 Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSTl_w5qmBIAWUgXumxbrVIN3UaosrqJIrLTjomDKY_UjsEd0Z82KaVZxFKyu-R15kkUOCiB_qQPa25LHQo7FqgOBKOFu-GN9r6TW593MrcCbijMHvGf04DcyKXBwKq90KIvuxf_z7VQwUZsQj6GziXCT4w8Zz-LaeTjsaCA_XWwCWg Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:26:12.587990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cec258de3eea4a12a7bd9b2b9832dce6"}]}] Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: a432229e175149b0bc254f19af8007fa Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:12.589498 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '2dd911f4-5f42-4dc7-8a40-2b62f807a2b1'} Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:26:12.590459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. Jun 30 04:26:12.592064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:26:12.593486 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8437eb83-cd12-4dba-98f7-d9ca0299733c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Returning 404 to user: Instance 2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:26:12.593486 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8437eb83-cd12-4dba-98f7-d9ca0299733c tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1" status: 404 len: 111 microversion: 2.1 time: 0.035229 Jun 30 04:26:12.593486 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 474/969] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:12 2022] GET /compute/v2.1/servers/2dd911f4-5f42-4dc7-8a40-2b62f807a2b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:26:13.740457 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6c3d61ac-5928-4616-9edb-a14eed5c7654 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:13.741021 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-6c3d61ac-5928-4616-9edb-a14eed5c7654 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:13.747903 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c3d61ac-5928-4616-9edb-a14eed5c7654 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:13.748356 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c3d61ac-5928-4616-9edb-a14eed5c7654 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:13.749119 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c3d61ac-5928-4616-9edb-a14eed5c7654 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:13.749555 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-6c3d61ac-5928-4616-9edb-a14eed5c7654 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:13.765358 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-6c3d61ac-5928-4616-9edb-a14eed5c7654 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] HTTP exception thrown: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6c3d61ac-5928-4616-9edb-a14eed5c7654 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Request method failure captured: Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: DELETE /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 HTTP/1.1 Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSTl_w5qmBIAWUgXumxbrVIN3UaosrqJIrLTjomDKY_UjsEd0Z82KaVZxFKyu-R15kkUOCiB_qQPa25LHQo7FqgOBKOFu-GN9r6TW593MrcCbijMHvGf04DcyKXBwKq90KIvuxf_z7VQwUZsQj6GziXCT4w8Zz-LaeTjsaCA_XWwCWg Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:26:13.766921 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cec258de3eea4a12a7bd9b2b9832dce6"}]}] Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: a432229e175149b0bc254f19af8007fa Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:26:13.768532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': 'b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5'} Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:26:13.769367 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:26:13.770682 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:26:13.772520 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-6c3d61ac-5928-4616-9edb-a14eed5c7654 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Returning 404 to user: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:26:13.772520 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-6c3d61ac-5928-4616-9edb-a14eed5c7654 tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 404 len: 111 microversion: 2.1 time: 0.031841 Jun 30 04:26:13.772520 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 496/970] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:26:13 2022] DELETE /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:26:13.778475 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-05061f81-411d-4bdd-a874-56d6b2ce935e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:13.779202 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-05061f81-411d-4bdd-a874-56d6b2ce935e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] [instance: b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:13.786065 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-05061f81-411d-4bdd-a874-56d6b2ce935e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:13.786520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-05061f81-411d-4bdd-a874-56d6b2ce935e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:13.787339 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-05061f81-411d-4bdd-a874-56d6b2ce935e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:13.787811 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-05061f81-411d-4bdd-a874-56d6b2ce935e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:13.801462 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-05061f81-411d-4bdd-a874-56d6b2ce935e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] HTTP exception thrown: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-05061f81-411d-4bdd-a874-56d6b2ce935e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Request method failure captured: Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 HTTP/1.1 Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSTl_w5qmBIAWUgXumxbrVIN3UaosrqJIrLTjomDKY_UjsEd0Z82KaVZxFKyu-R15kkUOCiB_qQPa25LHQo7FqgOBKOFu-GN9r6TW593MrcCbijMHvGf04DcyKXBwKq90KIvuxf_z7VQwUZsQj6GziXCT4w8Zz-LaeTjsaCA_XWwCWg Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:26:13.803000 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cec258de3eea4a12a7bd9b2b9832dce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cec258de3eea4a12a7bd9b2b9832dce6"}]}] Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: cec258de3eea4a12a7bd9b2b9832dce6 Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1888872629 Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: a432229e175149b0bc254f19af8007fa Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeTestJSON-1888872629-project Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:26:13.804616 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': 'b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5'} Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:26:13.805496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. Jun 30 04:26:13.807064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:26:13.808490 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-05061f81-411d-4bdd-a874-56d6b2ce935e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] Returning 404 to user: Instance b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:26:13.808490 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-05061f81-411d-4bdd-a874-56d6b2ce935e tempest-AttachVolumeTestJSON-1888872629 tempest-AttachVolumeTestJSON-1888872629-project] 10.222.0.13 "GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5" status: 404 len: 111 microversion: 2.1 time: 0.030232 Jun 30 04:26:13.808490 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 475/971] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:13 2022] GET /compute/v2.1/servers/b8b8afff-cd1f-47d8-9c47-cbb3ae7ed3e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 04:26:22.071965 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-18183ddf-3f48-4bcc-b934-b1bd836ce43f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: .version_select at 0x7fb480093820>, body: {"keypair": {"name": "tempest-keypair-1488768222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYO9V7uSUqEtI2ef1fUuI0ak/mkACiz6yrCmG1MJitVSQAAkjvEvC0EcX4LOIC7l7CNJMyLj1947pCNl2mhwMU1zMYT2//re7biNeBHP6Rv2dNLbJiKDs6CY3C3mwpcsA=="}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:26:22.086610 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-18183ddf-3f48-4bcc-b934-b1bd836ce43f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:26:22.091026 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-18183ddf-3f48-4bcc-b934-b1bd836ce43f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for user cab10b29f56246d1af122cfcbe20b2a6 and project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:26:22.117965 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-18183ddf-3f48-4bcc-b934-b1bd836ce43f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171586 Jun 30 04:26:22.119571 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 497/972] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 30 04:26:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:26:23.450055 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2011167958", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20ab151a-92d3-45f8-9aea-acc5912ac287"}], "security_groups": [{"name": "tempest-securitygroup--1016993172"}], "key_name": "tempest-keypair-1488768222", "user_data": "}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:26:23.565963 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] validate_networks() for [('20ab151a-92d3-45f8-9aea-acc5912ac287', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:26:23.793797 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:24.014064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:26:24.014483 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:26:24.014965 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:26:24.015409 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:26:24.015811 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:26:24.025292 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:24.025740 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:24.026541 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:24.026974 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:24.044515 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:26:24.048565 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for user cab10b29f56246d1af122cfcbe20b2a6 and project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:26:24.060277 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:26:24.062621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:26:24.107724 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [d6861fb3-e072-4a21-a057-e9f3f17237e0] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 04:26:25.118302 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [d6861fb3-e072-4a21-a057-e9f3f17237e0] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59462. Jun 30 04:26:25.124663 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b8197600-cb47-4761-990f-8d23cacaa264 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.679432 Jun 30 04:26:25.125470 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 476/973] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:26:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:26:25.138552 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-52c697cb-5513-421b-b049-b90813e9c97a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:25.139405 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-52c697cb-5513-421b-b049-b90813e9c97a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:25.142021 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:25.220360 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-52c697cb-5513-421b-b049-b90813e9c97a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:25.227919 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-52c697cb-5513-421b-b049-b90813e9c97a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1242 microversion: 2.1 time: 0.093257 Jun 30 04:26:25.228672 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 498/974] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:25 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:26.247131 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-276e05f7-ee94-410b-afe9-494e70f96d34 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:26.249359 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-276e05f7-ee94-410b-afe9-494e70f96d34 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:26.263356 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-276e05f7-ee94-410b-afe9-494e70f96d34 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:26.263884 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-276e05f7-ee94-410b-afe9-494e70f96d34 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:26.264809 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-276e05f7-ee94-410b-afe9-494e70f96d34 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:26.265314 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-276e05f7-ee94-410b-afe9-494e70f96d34 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:26.353733 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-276e05f7-ee94-410b-afe9-494e70f96d34 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:26.361682 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-276e05f7-ee94-410b-afe9-494e70f96d34 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1312 microversion: 2.1 time: 0.120471 Jun 30 04:26:26.362333 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 477/975] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:26 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:27.379996 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-3216cfa7-b221-47ac-92ec-7cd8ba5eaef0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:27.381503 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-3216cfa7-b221-47ac-92ec-7cd8ba5eaef0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:27.388472 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3216cfa7-b221-47ac-92ec-7cd8ba5eaef0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:27.388926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3216cfa7-b221-47ac-92ec-7cd8ba5eaef0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:27.389698 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3216cfa7-b221-47ac-92ec-7cd8ba5eaef0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:27.390135 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-3216cfa7-b221-47ac-92ec-7cd8ba5eaef0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:27.608246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-3216cfa7-b221-47ac-92ec-7cd8ba5eaef0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:27.615744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-3216cfa7-b221-47ac-92ec-7cd8ba5eaef0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1368 microversion: 2.1 time: 0.239860 Jun 30 04:26:27.616335 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 499/976] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:27 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:27.732766 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-0af551fd-120c-4ae8-a40d-500abb11f6df req-5badcd17-565d-4e86-9297-7ae3e3613238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19586bdb-46bd-4857-aec4-1fac4419d56f", "tag": "2de437f3-6471-40fa-99d7-87ecd143c0cb"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:26:27.745828 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-0af551fd-120c-4ae8-a40d-500abb11f6df req-5badcd17-565d-4e86-9297-7ae3e3613238 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:27.746266 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-0af551fd-120c-4ae8-a40d-500abb11f6df req-5badcd17-565d-4e86-9297-7ae3e3613238 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:27.763308 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-0af551fd-120c-4ae8-a40d-500abb11f6df req-5badcd17-565d-4e86-9297-7ae3e3613238 service nova] Creating event network-changed:2de437f3-6471-40fa-99d7-87ecd143c0cb for instance 19586bdb-46bd-4857-aec4-1fac4419d56f on hv-cinder-84684 Jun 30 04:26:27.769272 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-0af551fd-120c-4ae8-a40d-500abb11f6df req-5badcd17-565d-4e86-9297-7ae3e3613238 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040755 Jun 30 04:26:27.770290 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 478/977] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:26:28.636606 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-ecc1923a-d626-47a4-8246-bc27ab1e2c05 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:28.637491 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-ecc1923a-d626-47a4-8246-bc27ab1e2c05 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:28.644376 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ecc1923a-d626-47a4-8246-bc27ab1e2c05 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:28.644814 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ecc1923a-d626-47a4-8246-bc27ab1e2c05 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:28.645589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ecc1923a-d626-47a4-8246-bc27ab1e2c05 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:28.646018 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-ecc1923a-d626-47a4-8246-bc27ab1e2c05 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:28.780473 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-ecc1923a-d626-47a4-8246-bc27ab1e2c05 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:28.792934 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-ecc1923a-d626-47a4-8246-bc27ab1e2c05 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1368 microversion: 2.1 time: 0.162409 Jun 30 04:26:28.793512 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 500/978] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:28 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:29.814055 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-aec3286d-7ec1-4ec5-9059-50f159d0c474 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:29.814912 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-aec3286d-7ec1-4ec5-9059-50f159d0c474 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:29.824079 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aec3286d-7ec1-4ec5-9059-50f159d0c474 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:29.824554 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aec3286d-7ec1-4ec5-9059-50f159d0c474 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:29.825492 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aec3286d-7ec1-4ec5-9059-50f159d0c474 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:29.826029 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aec3286d-7ec1-4ec5-9059-50f159d0c474 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:29.966829 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-aec3286d-7ec1-4ec5-9059-50f159d0c474 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:29.974871 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-aec3286d-7ec1-4ec5-9059-50f159d0c474 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1368 microversion: 2.1 time: 0.167068 Jun 30 04:26:29.975486 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 479/979] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:29 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:30.998135 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-0ffff318-dfb0-45d9-bbf9-749b26a272f5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:30.998710 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-0ffff318-dfb0-45d9-bbf9-749b26a272f5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:31.005709 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0ffff318-dfb0-45d9-bbf9-749b26a272f5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:31.006157 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0ffff318-dfb0-45d9-bbf9-749b26a272f5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:31.006940 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0ffff318-dfb0-45d9-bbf9-749b26a272f5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:31.007407 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-0ffff318-dfb0-45d9-bbf9-749b26a272f5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:31.149052 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-0ffff318-dfb0-45d9-bbf9-749b26a272f5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:31.156955 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-0ffff318-dfb0-45d9-bbf9-749b26a272f5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1368 microversion: 2.1 time: 0.162865 Jun 30 04:26:31.157572 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 501/980] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:30 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:32.178114 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f56242d5-7452-4b01-8aaa-48cb3c278eca tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:32.178688 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f56242d5-7452-4b01-8aaa-48cb3c278eca tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:32.185913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f56242d5-7452-4b01-8aaa-48cb3c278eca tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:32.186398 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f56242d5-7452-4b01-8aaa-48cb3c278eca tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:32.187156 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f56242d5-7452-4b01-8aaa-48cb3c278eca tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:32.187624 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f56242d5-7452-4b01-8aaa-48cb3c278eca tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:32.328083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f56242d5-7452-4b01-8aaa-48cb3c278eca tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:32.335718 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f56242d5-7452-4b01-8aaa-48cb3c278eca tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1368 microversion: 2.1 time: 0.161642 Jun 30 04:26:32.336304 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 480/981] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:32 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:32.672625 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-ba7b262c-cdb3-4197-acef-83a3686f97ea req-520f7b6f-8364-4152-9f27-1e00450be515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19586bdb-46bd-4857-aec4-1fac4419d56f", "name": "network-vif-plugged", "status": "completed", "tag": "2de437f3-6471-40fa-99d7-87ecd143c0cb"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:26:32.682830 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-ba7b262c-cdb3-4197-acef-83a3686f97ea req-520f7b6f-8364-4152-9f27-1e00450be515 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:32.683320 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-ba7b262c-cdb3-4197-acef-83a3686f97ea req-520f7b6f-8364-4152-9f27-1e00450be515 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:32.694465 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-ba7b262c-cdb3-4197-acef-83a3686f97ea req-520f7b6f-8364-4152-9f27-1e00450be515 service nova] Creating event network-vif-plugged:2de437f3-6471-40fa-99d7-87ecd143c0cb for instance 19586bdb-46bd-4857-aec4-1fac4419d56f on hv-cinder-84684 Jun 30 04:26:32.699916 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-ba7b262c-cdb3-4197-acef-83a3686f97ea req-520f7b6f-8364-4152-9f27-1e00450be515 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091525 Jun 30 04:26:32.700909 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 502/982] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:26:33.358868 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5fa3521e-ff89-44dd-ae13-2bb52bef57b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:33.359637 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5fa3521e-ff89-44dd-ae13-2bb52bef57b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:33.368277 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5fa3521e-ff89-44dd-ae13-2bb52bef57b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:33.368840 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5fa3521e-ff89-44dd-ae13-2bb52bef57b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:33.369798 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5fa3521e-ff89-44dd-ae13-2bb52bef57b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:33.370345 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5fa3521e-ff89-44dd-ae13-2bb52bef57b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:33.505264 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5fa3521e-ff89-44dd-ae13-2bb52bef57b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:33.513114 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5fa3521e-ff89-44dd-ae13-2bb52bef57b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1368 microversion: 2.1 time: 0.159972 Jun 30 04:26:33.513685 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 481/983] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:33 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:34.533429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d825787b-be55-4c57-b6ab-41808ff8d039 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:34.534211 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d825787b-be55-4c57-b6ab-41808ff8d039 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:34.537058 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:34.544128 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d825787b-be55-4c57-b6ab-41808ff8d039 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:34.544650 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d825787b-be55-4c57-b6ab-41808ff8d039 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:34.545537 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d825787b-be55-4c57-b6ab-41808ff8d039 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:34.546044 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d825787b-be55-4c57-b6ab-41808ff8d039 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:34.685577 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-d825787b-be55-4c57-b6ab-41808ff8d039 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:26:34.693481 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d825787b-be55-4c57-b6ab-41808ff8d039 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1559 microversion: 2.1 time: 0.165072 Jun 30 04:26:34.694078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 503/984] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:26:34 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:26:34.710064 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9eaba024-95db-4759-a8e6-c0d2772f8b3e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:26:34.710584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9eaba024-95db-4759-a8e6-c0d2772f8b3e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:26:34.712563 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:34.713222 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:34.714671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:34.721053 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9eaba024-95db-4759-a8e6-c0d2772f8b3e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:34.721500 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9eaba024-95db-4759-a8e6-c0d2772f8b3e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:34.722261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9eaba024-95db-4759-a8e6-c0d2772f8b3e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:34.722694 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9eaba024-95db-4759-a8e6-c0d2772f8b3e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:34.802497 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9eaba024-95db-4759-a8e6-c0d2772f8b3e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096360 Jun 30 04:26:34.803124 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 482/985] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 30 04:26:34 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:26:36.105669 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-bc9189eb-0269-4469-a84c-f6439cf6f537 req-e4e8a3d8-f5ed-42eb-8736-5f6fe2603440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19586bdb-46bd-4857-aec4-1fac4419d56f", "tag": "2de437f3-6471-40fa-99d7-87ecd143c0cb"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:26:36.109204 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=6 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:26:36.115956 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-bc9189eb-0269-4469-a84c-f6439cf6f537 req-e4e8a3d8-f5ed-42eb-8736-5f6fe2603440 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:26:36.116397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-bc9189eb-0269-4469-a84c-f6439cf6f537 req-e4e8a3d8-f5ed-42eb-8736-5f6fe2603440 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:26:36.128022 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-bc9189eb-0269-4469-a84c-f6439cf6f537 req-e4e8a3d8-f5ed-42eb-8736-5f6fe2603440 service nova] Creating event network-changed:2de437f3-6471-40fa-99d7-87ecd143c0cb for instance 19586bdb-46bd-4857-aec4-1fac4419d56f on hv-cinder-84684 Jun 30 04:26:36.132870 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-bc9189eb-0269-4469-a84c-f6439cf6f537 req-e4e8a3d8-f5ed-42eb-8736-5f6fe2603440 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030912 Jun 30 04:26:36.133661 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 504/986] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:27:09.997268 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=32 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:27:09.998377 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:27:10.004562 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8b19ba00-8ca0-43fa-97a6-6276ad1a116b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:10.005428 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8b19ba00-8ca0-43fa-97a6-6276ad1a116b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:10.015664 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b19ba00-8ca0-43fa-97a6-6276ad1a116b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:10.016349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b19ba00-8ca0-43fa-97a6-6276ad1a116b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:10.017491 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b19ba00-8ca0-43fa-97a6-6276ad1a116b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:10.018125 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8b19ba00-8ca0-43fa-97a6-6276ad1a116b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:10.043761 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8b19ba00-8ca0-43fa-97a6-6276ad1a116b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/ips" status: 200 len: 151 microversion: 2.1 time: 0.049172 Jun 30 04:27:10.044318 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 483/987] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 30 04:27:09 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:27:11.418790 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:27:11.419653 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=28 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:27:11.424341 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-43a91fec-2138-46fd-b461-a73ae9a647a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9763f382-f31e-4984-9965-c544d8ae77d1"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:27:11.425515 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-43a91fec-2138-46fd-b461-a73ae9a647a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:11.433314 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-43a91fec-2138-46fd-b461-a73ae9a647a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:11.433843 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-43a91fec-2138-46fd-b461-a73ae9a647a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:11.434715 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-43a91fec-2138-46fd-b461-a73ae9a647a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:11.435289 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-43a91fec-2138-46fd-b461-a73ae9a647a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:11.685791 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-43a91fec-2138-46fd-b461-a73ae9a647a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268498 Jun 30 04:27:11.686376 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 505/988] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:27:11 2022] POST /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:27:18.178347 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-466f95ac-c1c7-4c3e-989a-5ac1e31d8e1b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: .version_select at 0x7fb4801f9ee0>, body: {"keypair": {"name": "tempest-keypair-28510389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFB5dAdv9tyPkqP/ObI0wCSIcltNQkPeHD3GrwT8v+f2t/L4YUwMmOhljjYy61Yazd8ol+f2/W4ro2Fd5FH4/8nJuBMhQaaxwGFZTuUm2vfPlso9SuvHlBa0at+CL6rQ=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:27:18.193591 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-466f95ac-c1c7-4c3e-989a-5ac1e31d8e1b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:27:18.198155 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-466f95ac-c1c7-4c3e-989a-5ac1e31d8e1b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for user cab10b29f56246d1af122cfcbe20b2a6 and project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:27:18.222258 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-466f95ac-c1c7-4c3e-989a-5ac1e31d8e1b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.047786 Jun 30 04:27:18.222840 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 484/989] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 30 04:27:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:27:19.509981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1070603366", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20ab151a-92d3-45f8-9aea-acc5912ac287"}], "security_groups": [{"name": "tempest-securitygroup--1492237328"}], "key_name": "tempest-keypair-28510389", "user_data": "}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:27:19.615608 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] validate_networks() for [('20ab151a-92d3-45f8-9aea-acc5912ac287', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:27:20.065697 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:27:20.066404 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:27:20.067154 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:27:20.067879 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:27:20.068554 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:27:20.079129 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:20.079603 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:20.080363 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:20.080793 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:20.098205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:27:20.102755 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for user cab10b29f56246d1af122cfcbe20b2a6 and project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:27:20.115383 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:27:20.117746 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:27:20.165508 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [68a095a2-63cd-4708-bef3-107b6b9600b0] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 04:27:21.178382 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO oslo.messaging._drivers.impl_rabbit [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [68a095a2-63cd-4708-bef3-107b6b9600b0] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 59580. Jun 30 04:27:21.185145 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b08c56d1-cf44-4066-850a-3cb57cbd57a8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.680348 Jun 30 04:27:21.185963 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 506/990] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:27:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:27:21.193432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=4 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:27:21.197579 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-56ea2eff-b628-4fa7-a1a6-bd16b4757f03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:21.198270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-56ea2eff-b628-4fa7-a1a6-bd16b4757f03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:21.253440 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-56ea2eff-b628-4fa7-a1a6-bd16b4757f03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:27:21.260223 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-56ea2eff-b628-4fa7-a1a6-bd16b4757f03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1240 microversion: 2.1 time: 0.068066 Jun 30 04:27:21.260990 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 485/991] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:27:21 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:27:22.282602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fb1c194c-a85f-4831-b0eb-33f21d9c868d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:22.283694 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-fb1c194c-a85f-4831-b0eb-33f21d9c868d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:22.294562 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fb1c194c-a85f-4831-b0eb-33f21d9c868d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:22.295004 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fb1c194c-a85f-4831-b0eb-33f21d9c868d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:22.295798 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fb1c194c-a85f-4831-b0eb-33f21d9c868d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:22.296261 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-fb1c194c-a85f-4831-b0eb-33f21d9c868d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:22.367272 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-fb1c194c-a85f-4831-b0eb-33f21d9c868d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:27:22.375042 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fb1c194c-a85f-4831-b0eb-33f21d9c868d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1292 microversion: 2.1 time: 0.099940 Jun 30 04:27:22.375667 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 507/992] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:27:22 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:27:23.392487 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e137185f-0ae0-40cf-a341-bad8232fc353 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:23.393088 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e137185f-0ae0-40cf-a341-bad8232fc353 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:23.400285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e137185f-0ae0-40cf-a341-bad8232fc353 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:23.400770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e137185f-0ae0-40cf-a341-bad8232fc353 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:23.401548 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e137185f-0ae0-40cf-a341-bad8232fc353 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:23.401980 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e137185f-0ae0-40cf-a341-bad8232fc353 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:23.647565 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e137185f-0ae0-40cf-a341-bad8232fc353 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:27:23.656417 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e137185f-0ae0-40cf-a341-bad8232fc353 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1366 microversion: 2.1 time: 0.268206 Jun 30 04:27:23.657006 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 486/993] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:27:23 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:27:23.948739 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-75377e50-6dd0-4c02-83ff-a236cf23edf6 req-727829f8-4b62-4169-9a25-ef7739101140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c41def07-cddb-4708-ac21-12522d278e62", "tag": "35726dcc-98b0-43bc-b947-79080a8c0ff3"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:27:23.960328 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-75377e50-6dd0-4c02-83ff-a236cf23edf6 req-727829f8-4b62-4169-9a25-ef7739101140 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:23.961295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-75377e50-6dd0-4c02-83ff-a236cf23edf6 req-727829f8-4b62-4169-9a25-ef7739101140 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:23.974754 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-75377e50-6dd0-4c02-83ff-a236cf23edf6 req-727829f8-4b62-4169-9a25-ef7739101140 service nova] Creating event network-changed:35726dcc-98b0-43bc-b947-79080a8c0ff3 for instance c41def07-cddb-4708-ac21-12522d278e62 on hv-cinder-84684 Jun 30 04:27:23.979898 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-75377e50-6dd0-4c02-83ff-a236cf23edf6 req-727829f8-4b62-4169-9a25-ef7739101140 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035905 Jun 30 04:27:23.980621 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 508/994] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:27:24.678053 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-935df7c3-c24f-4bce-9a57-3b44f687901d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:24.679053 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-935df7c3-c24f-4bce-9a57-3b44f687901d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:24.690594 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-935df7c3-c24f-4bce-9a57-3b44f687901d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:24.691385 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-935df7c3-c24f-4bce-9a57-3b44f687901d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:24.692637 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-935df7c3-c24f-4bce-9a57-3b44f687901d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:24.693369 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-935df7c3-c24f-4bce-9a57-3b44f687901d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:24.840592 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-935df7c3-c24f-4bce-9a57-3b44f687901d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:27:24.848246 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-935df7c3-c24f-4bce-9a57-3b44f687901d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1366 microversion: 2.1 time: 0.176868 Jun 30 04:27:24.848802 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 487/995] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:27:24 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:27:25.870434 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7ec559e0-2fbb-4cba-b375-4750a6a6dc87 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:25.871579 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-7ec559e0-2fbb-4cba-b375-4750a6a6dc87 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:25.879463 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7ec559e0-2fbb-4cba-b375-4750a6a6dc87 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:25.879903 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7ec559e0-2fbb-4cba-b375-4750a6a6dc87 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:25.880649 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7ec559e0-2fbb-4cba-b375-4750a6a6dc87 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:25.881073 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-7ec559e0-2fbb-4cba-b375-4750a6a6dc87 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:26.031616 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-7ec559e0-2fbb-4cba-b375-4750a6a6dc87 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:27:26.041555 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7ec559e0-2fbb-4cba-b375-4750a6a6dc87 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1366 microversion: 2.1 time: 0.178653 Jun 30 04:27:26.042155 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 509/996] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:27:25 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:27:27.062973 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d57ca3f3-d9c1-4346-8f48-c931a28425ce tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:27.063652 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d57ca3f3-d9c1-4346-8f48-c931a28425ce tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:27.071405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d57ca3f3-d9c1-4346-8f48-c931a28425ce tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:27.071856 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d57ca3f3-d9c1-4346-8f48-c931a28425ce tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:27.072628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d57ca3f3-d9c1-4346-8f48-c931a28425ce tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:27.073070 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d57ca3f3-d9c1-4346-8f48-c931a28425ce tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:27.213219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d57ca3f3-d9c1-4346-8f48-c931a28425ce tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:27:27.221116 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d57ca3f3-d9c1-4346-8f48-c931a28425ce tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1366 microversion: 2.1 time: 0.164918 Jun 30 04:27:27.221701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 488/997] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:27:27 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:27:28.242362 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-9064082a-0aae-4304-b139-7ab6bba44e16 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:28.243458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-9064082a-0aae-4304-b139-7ab6bba44e16 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:28.254762 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9064082a-0aae-4304-b139-7ab6bba44e16 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:28.255581 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9064082a-0aae-4304-b139-7ab6bba44e16 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:28.256860 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9064082a-0aae-4304-b139-7ab6bba44e16 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:28.257582 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-9064082a-0aae-4304-b139-7ab6bba44e16 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:28.403480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-9064082a-0aae-4304-b139-7ab6bba44e16 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:27:28.411335 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-9064082a-0aae-4304-b139-7ab6bba44e16 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1366 microversion: 2.1 time: 0.175615 Jun 30 04:27:28.411930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 510/998] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:27:28 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:27:28.874957 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-2875383a-0b77-48f1-819b-ac2d21242865 req-e8970395-5653-4d65-b792-0ab7f5ca64a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41def07-cddb-4708-ac21-12522d278e62", "name": "network-vif-plugged", "status": "completed", "tag": "35726dcc-98b0-43bc-b947-79080a8c0ff3"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:27:28.885482 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-2875383a-0b77-48f1-819b-ac2d21242865 req-e8970395-5653-4d65-b792-0ab7f5ca64a6 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:28.885482 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-2875383a-0b77-48f1-819b-ac2d21242865 req-e8970395-5653-4d65-b792-0ab7f5ca64a6 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:28.899374 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-2875383a-0b77-48f1-819b-ac2d21242865 req-e8970395-5653-4d65-b792-0ab7f5ca64a6 service nova] Creating event network-vif-plugged:35726dcc-98b0-43bc-b947-79080a8c0ff3 for instance c41def07-cddb-4708-ac21-12522d278e62 on hv-cinder-84684 Jun 30 04:27:28.904396 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-2875383a-0b77-48f1-819b-ac2d21242865 req-e8970395-5653-4d65-b792-0ab7f5ca64a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033434 Jun 30 04:27:28.905313 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 489/999] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:27:29.431815 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-451b9253-a806-4e80-b7ae-5a5b5c4ff223 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:29.433485 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-451b9253-a806-4e80-b7ae-5a5b5c4ff223 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:29.443209 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-451b9253-a806-4e80-b7ae-5a5b5c4ff223 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:29.443659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-451b9253-a806-4e80-b7ae-5a5b5c4ff223 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:29.444414 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-451b9253-a806-4e80-b7ae-5a5b5c4ff223 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:29.444849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-451b9253-a806-4e80-b7ae-5a5b5c4ff223 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:29.584252 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-451b9253-a806-4e80-b7ae-5a5b5c4ff223 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:27:29.592063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-451b9253-a806-4e80-b7ae-5a5b5c4ff223 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1366 microversion: 2.1 time: 0.167128 Jun 30 04:27:29.592637 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 511/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:27:29 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:27:30.610560 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d8f99c94-bc8a-4119-8a9f-b2f6b27bd60e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:30.611586 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d8f99c94-bc8a-4119-8a9f-b2f6b27bd60e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:30.618318 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d8f99c94-bc8a-4119-8a9f-b2f6b27bd60e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:30.618756 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d8f99c94-bc8a-4119-8a9f-b2f6b27bd60e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:30.619544 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d8f99c94-bc8a-4119-8a9f-b2f6b27bd60e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:30.619973 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d8f99c94-bc8a-4119-8a9f-b2f6b27bd60e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:30.756435 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d8f99c94-bc8a-4119-8a9f-b2f6b27bd60e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:27:30.767658 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d8f99c94-bc8a-4119-8a9f-b2f6b27bd60e tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1557 microversion: 2.1 time: 0.161890 Jun 30 04:27:30.768413 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 490/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:27:30 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:27:30.792143 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-aa7162ae-d199-45cc-9d2f-544848fec6f2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:27:30.792678 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-aa7162ae-d199-45cc-9d2f-544848fec6f2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:27:30.795690 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:27:30.796556 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=6 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:27:30.807312 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aa7162ae-d199-45cc-9d2f-544848fec6f2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:30.807949 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aa7162ae-d199-45cc-9d2f-544848fec6f2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:30.809130 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aa7162ae-d199-45cc-9d2f-544848fec6f2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:30.809816 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aa7162ae-d199-45cc-9d2f-544848fec6f2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:30.888069 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-aa7162ae-d199-45cc-9d2f-544848fec6f2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102270 Jun 30 04:27:30.888672 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 512/1002] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 30 04:27:30 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:27:32.098473 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-5ba74e3e-c21a-4715-865a-17a572e3dfca req-9c72aee1-7cc1-494a-af47-ce86f0a2d71b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c41def07-cddb-4708-ac21-12522d278e62", "tag": "35726dcc-98b0-43bc-b947-79080a8c0ff3"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:27:32.102175 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:27:32.108899 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-5ba74e3e-c21a-4715-865a-17a572e3dfca req-9c72aee1-7cc1-494a-af47-ce86f0a2d71b service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:27:32.109345 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-5ba74e3e-c21a-4715-865a-17a572e3dfca req-9c72aee1-7cc1-494a-af47-ce86f0a2d71b service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:27:32.120733 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-5ba74e3e-c21a-4715-865a-17a572e3dfca req-9c72aee1-7cc1-494a-af47-ce86f0a2d71b service nova] Creating event network-changed:35726dcc-98b0-43bc-b947-79080a8c0ff3 for instance c41def07-cddb-4708-ac21-12522d278e62 on hv-cinder-84684 Jun 30 04:27:32.125633 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-5ba74e3e-c21a-4715-865a-17a572e3dfca req-9c72aee1-7cc1-494a-af47-ce86f0a2d71b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031412 Jun 30 04:27:32.126269 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 491/1003] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:06.380274 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:06.381634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:06.388379 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b0440a57-93d1-4f90-ae4b-efe43a734fda tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:06.388871 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b0440a57-93d1-4f90-ae4b-efe43a734fda tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:06.396611 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b0440a57-93d1-4f90-ae4b-efe43a734fda tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:06.397055 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b0440a57-93d1-4f90-ae4b-efe43a734fda tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:06.397816 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b0440a57-93d1-4f90-ae4b-efe43a734fda tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:06.398230 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b0440a57-93d1-4f90-ae4b-efe43a734fda tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:06.422870 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b0440a57-93d1-4f90-ae4b-efe43a734fda tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62/ips" status: 200 len: 151 microversion: 2.1 time: 0.044880 Jun 30 04:28:06.423478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 513/1004] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 30 04:28:06 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:06.431866 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:06.432658 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=28 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:06.437611 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7938e851-cf4b-4016-88cd-0036ca89c021 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9763f382-f31e-4984-9965-c544d8ae77d1"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:28:06.438754 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7938e851-cf4b-4016-88cd-0036ca89c021 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:06.445935 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7938e851-cf4b-4016-88cd-0036ca89c021 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:06.446375 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7938e851-cf4b-4016-88cd-0036ca89c021 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:06.447142 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7938e851-cf4b-4016-88cd-0036ca89c021 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:06.447572 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7938e851-cf4b-4016-88cd-0036ca89c021 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:06.536835 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-7938e851-cf4b-4016-88cd-0036ca89c021 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Invalid volume: volume 9763f382-f31e-4984-9965-c544d8ae77d1 is already attached to instances: 19586bdb-46bd-4857-aec4-1fac4419d56f Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7938e851-cf4b-4016-88cd-0036ca89c021 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: POST /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62/os-volume_attachments HTTP/1.1 Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 74 Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:28:06.538584 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {"volumeAttachment": {"volumeId": "9763f382-f31e-4984-9965-c544d8ae77d1"}} Jun 30 04:28:06.540270 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Invalid volume: volume 9763f382-f31e-4984-9965-c544d8ae77d1 is already attached to instances: 19586bdb-46bd-4857-aec4-1fac4419d56f Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'server_id': 'c41def07-cddb-4708-ac21-12522d278e62', 'body': {'volumeAttachment': {'volumeId': '9763f382-f31e-4984-9965-c544d8ae77d1'}}} Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9763f382-f31e-4984-9965-c544d8ae77d1 is already attached to instances: 19586bdb-46bd-4857-aec4-1fac4419d56f Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:06.541261 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9763f382-f31e-4984-9965-c544d8ae77d1 is already attached to instances: 19586bdb-46bd-4857-aec4-1fac4419d56f Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:28:06.542794 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:28:06.544496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:28:06.544496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:28:06.544496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:28:06.544496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9763f382-f31e-4984-9965-c544d8ae77d1 is already attached to instances: 19586bdb-46bd-4857-aec4-1fac4419d56f Jun 30 04:28:06.544496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:06.544496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7938e851-cf4b-4016-88cd-0036ca89c021 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 400 to user: Invalid volume: volume 9763f382-f31e-4984-9965-c544d8ae77d1 is already attached to instances: 19586bdb-46bd-4857-aec4-1fac4419d56f {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:28:06.544496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7938e851-cf4b-4016-88cd-0036ca89c021 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109772 Jun 30 04:28:06.544496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 492/1005] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:28:06 2022] POST /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 04:28:06.548910 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-036ec45f-2ba1-4679-bbe9-9a0f17dcf76f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:06.549412 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-036ec45f-2ba1-4679-bbe9-9a0f17dcf76f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:06.555695 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-036ec45f-2ba1-4679-bbe9-9a0f17dcf76f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:06.556138 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-036ec45f-2ba1-4679-bbe9-9a0f17dcf76f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:06.556911 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-036ec45f-2ba1-4679-bbe9-9a0f17dcf76f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:06.557337 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-036ec45f-2ba1-4679-bbe9-9a0f17dcf76f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:06.582169 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-036ec45f-2ba1-4679-bbe9-9a0f17dcf76f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:28:06.662269 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-036ec45f-2ba1-4679-bbe9-9a0f17dcf76f tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 204 len: 0 microversion: 2.1 time: 0.116916 Jun 30 04:28:06.662953 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 514/1006] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:28:06 2022] DELETE /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:28:06.672752 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3f6bb517-fe17-4027-8ed5-9c23fa4eeb25 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:06.673568 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3f6bb517-fe17-4027-8ed5-9c23fa4eeb25 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:06.683808 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f6bb517-fe17-4027-8ed5-9c23fa4eeb25 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:06.684343 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f6bb517-fe17-4027-8ed5-9c23fa4eeb25 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:06.685447 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f6bb517-fe17-4027-8ed5-9c23fa4eeb25 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:06.686021 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f6bb517-fe17-4027-8ed5-9c23fa4eeb25 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:06.832221 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3f6bb517-fe17-4027-8ed5-9c23fa4eeb25 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:06.844087 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3f6bb517-fe17-4027-8ed5-9c23fa4eeb25 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1682 microversion: 2.1 time: 0.176054 Jun 30 04:28:06.844875 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 493/1007] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:06 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:28:07.865041 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-dcc7fc1c-5188-482f-bca0-d1e2fcf56062 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:07.866012 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-dcc7fc1c-5188-482f-bca0-d1e2fcf56062 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:07.876369 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dcc7fc1c-5188-482f-bca0-d1e2fcf56062 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:07.877058 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dcc7fc1c-5188-482f-bca0-d1e2fcf56062 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:07.878083 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dcc7fc1c-5188-482f-bca0-d1e2fcf56062 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:07.878663 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-dcc7fc1c-5188-482f-bca0-d1e2fcf56062 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:08.058477 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-dcc7fc1c-5188-482f-bca0-d1e2fcf56062 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:08.067837 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-dcc7fc1c-5188-482f-bca0-d1e2fcf56062 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1682 microversion: 2.1 time: 0.208471 Jun 30 04:28:08.068419 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 515/1008] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:07 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:08.880920 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-912f0ff5-3d7c-4b83-8489-81c062c3d095 req-6124b1ba-ea82-444d-beaf-6c7714112428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41def07-cddb-4708-ac21-12522d278e62", "name": "network-vif-deleted", "tag": "35726dcc-98b0-43bc-b947-79080a8c0ff3"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:28:08.898709 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-912f0ff5-3d7c-4b83-8489-81c062c3d095 req-6124b1ba-ea82-444d-beaf-6c7714112428 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:08.899541 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-912f0ff5-3d7c-4b83-8489-81c062c3d095 req-6124b1ba-ea82-444d-beaf-6c7714112428 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:08.912680 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-912f0ff5-3d7c-4b83-8489-81c062c3d095 req-6124b1ba-ea82-444d-beaf-6c7714112428 service nova] Creating event network-vif-deleted:35726dcc-98b0-43bc-b947-79080a8c0ff3 for instance c41def07-cddb-4708-ac21-12522d278e62 on hv-cinder-84684 Jun 30 04:28:08.918921 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-912f0ff5-3d7c-4b83-8489-81c062c3d095 req-6124b1ba-ea82-444d-beaf-6c7714112428 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041421 Jun 30 04:28:08.919879 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 494/1009] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:09.085461 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:09.086159 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:09.093418 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:09.093904 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:09.094719 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:09.095141 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:09.131290 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:09.132194 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:09.132194 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lazy-loading 'fault' on Instance uuid c41def07-cddb-4708-ac21-12522d278e62 {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:28:09.173926 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:09.181781 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-36948316-5fa9-4a8c-85ff-18b8bd362beb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 200 len: 1330 microversion: 2.1 time: 0.100232 Jun 30 04:28:09.182329 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 516/1010] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:09 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:10.204687 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a9f1ed7f-bfc8-49f5-b25f-a9e42accd542 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:10.205737 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a9f1ed7f-bfc8-49f5-b25f-a9e42accd542 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:10.217009 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9f1ed7f-bfc8-49f5-b25f-a9e42accd542 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:10.217459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9f1ed7f-bfc8-49f5-b25f-a9e42accd542 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:10.218224 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9f1ed7f-bfc8-49f5-b25f-a9e42accd542 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:10.218657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9f1ed7f-bfc8-49f5-b25f-a9e42accd542 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:10.232266 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-a9f1ed7f-bfc8-49f5-b25f-a9e42accd542 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a9f1ed7f-bfc8-49f5-b25f-a9e42accd542 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 HTTP/1.1 Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:28:10.233971 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:28:10.235593 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': 'c41def07-cddb-4708-ac21-12522d278e62'} Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:28:10.236432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:28:10.238068 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:10.239682 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a9f1ed7f-bfc8-49f5-b25f-a9e42accd542 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:28:10.239682 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a9f1ed7f-bfc8-49f5-b25f-a9e42accd542 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 404 len: 111 microversion: 2.1 time: 0.038215 Jun 30 04:28:10.239682 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 495/1011] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:10 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:28:10.244439 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-fa2b86d8-c9bb-458a-a015-86f5be6eab0a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '.version_select at 0x7fb48018ad30>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:10.265142 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-fa2b86d8-c9bb-458a-a015-86f5be6eab0a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-28510389" status: 202 len: 0 microversion: 2.1 time: 0.024574 Jun 30 04:28:10.265712 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 517/1012] 10.222.0.13 () {58 vars in 1214 bytes} [Thu Jun 30 04:28:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-28510389 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:28:11.176191 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f180b761-5514-459e-9a65-48c031fd4a7c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:11.176689 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f180b761-5514-459e-9a65-48c031fd4a7c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:11.183152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f180b761-5514-459e-9a65-48c031fd4a7c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:11.183632 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f180b761-5514-459e-9a65-48c031fd4a7c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:11.184393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f180b761-5514-459e-9a65-48c031fd4a7c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:11.184826 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f180b761-5514-459e-9a65-48c031fd4a7c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:11.273538 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-f180b761-5514-459e-9a65-48c031fd4a7c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lazy-loading 'services' on Instance uuid 19586bdb-46bd-4857-aec4-1fac4419d56f {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:28:11.352374 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f180b761-5514-459e-9a65-48c031fd4a7c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/os-volume_attachments/9763f382-f31e-4984-9965-c544d8ae77d1" status: 202 len: 0 microversion: 2.1 time: 0.179987 Jun 30 04:28:11.352944 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 496/1013] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:28:11 2022] DELETE /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/os-volume_attachments/9763f382-f31e-4984-9965-c544d8ae77d1 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:28:11.361995 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-51628280-7a3f-4ae1-9724-558460dc8e70 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:11.363009 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-51628280-7a3f-4ae1-9724-558460dc8e70 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:11.369697 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51628280-7a3f-4ae1-9724-558460dc8e70 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:11.370138 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51628280-7a3f-4ae1-9724-558460dc8e70 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:11.370899 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51628280-7a3f-4ae1-9724-558460dc8e70 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:11.371372 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-51628280-7a3f-4ae1-9724-558460dc8e70 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:11.403460 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-51628280-7a3f-4ae1-9724-558460dc8e70 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045850 Jun 30 04:28:11.407413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 518/1014] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:28:11 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:12.421494 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-34ccda83-e6b1-4882-a0bb-62514a885a20 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:12.422658 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-34ccda83-e6b1-4882-a0bb-62514a885a20 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:12.430424 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-34ccda83-e6b1-4882-a0bb-62514a885a20 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:12.430953 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-34ccda83-e6b1-4882-a0bb-62514a885a20 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:12.431873 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-34ccda83-e6b1-4882-a0bb-62514a885a20 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:12.432373 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-34ccda83-e6b1-4882-a0bb-62514a885a20 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:12.464981 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-34ccda83-e6b1-4882-a0bb-62514a885a20 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051774 Jun 30 04:28:12.465538 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 497/1015] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:28:12 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 04:28:12.523530 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d0ea7317-5ad7-411b-a689-6519bb9854ea tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:12.524070 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d0ea7317-5ad7-411b-a689-6519bb9854ea tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:12.531427 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d0ea7317-5ad7-411b-a689-6519bb9854ea tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:12.531883 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d0ea7317-5ad7-411b-a689-6519bb9854ea tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:12.532642 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d0ea7317-5ad7-411b-a689-6519bb9854ea tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:12.533078 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d0ea7317-5ad7-411b-a689-6519bb9854ea tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:12.560419 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d0ea7317-5ad7-411b-a689-6519bb9854ea tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:28:12.647544 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d0ea7317-5ad7-411b-a689-6519bb9854ea tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 204 len: 0 microversion: 2.1 time: 0.128117 Jun 30 04:28:12.648162 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 519/1016] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:28:12 2022] DELETE /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:28:12.657550 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3af425bd-49e5-4d3b-9eb1-838b3e995693 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:12.658187 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3af425bd-49e5-4d3b-9eb1-838b3e995693 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:12.664354 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3af425bd-49e5-4d3b-9eb1-838b3e995693 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:12.664795 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3af425bd-49e5-4d3b-9eb1-838b3e995693 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:12.665564 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3af425bd-49e5-4d3b-9eb1-838b3e995693 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:12.665989 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3af425bd-49e5-4d3b-9eb1-838b3e995693 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:12.809278 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3af425bd-49e5-4d3b-9eb1-838b3e995693 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:12.818699 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3af425bd-49e5-4d3b-9eb1-838b3e995693 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1684 microversion: 2.1 time: 0.165813 Jun 30 04:28:12.819606 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 498/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:12 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:13.839543 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-78405315-a168-4ce8-ae95-51a62deec965 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:13.840246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-78405315-a168-4ce8-ae95-51a62deec965 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:13.847478 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-78405315-a168-4ce8-ae95-51a62deec965 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:13.847928 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-78405315-a168-4ce8-ae95-51a62deec965 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:13.848705 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-78405315-a168-4ce8-ae95-51a62deec965 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:13.849221 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-78405315-a168-4ce8-ae95-51a62deec965 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:13.988232 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-78405315-a168-4ce8-ae95-51a62deec965 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:13.996208 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-78405315-a168-4ce8-ae95-51a62deec965 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1684 microversion: 2.1 time: 0.161026 Jun 30 04:28:13.996857 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 520/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:13 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:15.001152 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-31a7ff77-c810-45d3-937c-12328e8a515b req-7353f716-ab84-4150-b8af-77e8d15141bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19586bdb-46bd-4857-aec4-1fac4419d56f", "name": "network-vif-deleted", "tag": "2de437f3-6471-40fa-99d7-87ecd143c0cb"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:28:15.013907 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-31a7ff77-c810-45d3-937c-12328e8a515b req-7353f716-ab84-4150-b8af-77e8d15141bb service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:15.014358 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-31a7ff77-c810-45d3-937c-12328e8a515b req-7353f716-ab84-4150-b8af-77e8d15141bb service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:15.015741 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-72f20584-ac41-4c81-92cf-a74907915f6d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:15.017064 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-72f20584-ac41-4c81-92cf-a74907915f6d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:15.025105 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-72f20584-ac41-4c81-92cf-a74907915f6d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:15.025873 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-72f20584-ac41-4c81-92cf-a74907915f6d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:15.026885 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-72f20584-ac41-4c81-92cf-a74907915f6d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:15.027023 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-31a7ff77-c810-45d3-937c-12328e8a515b req-7353f716-ab84-4150-b8af-77e8d15141bb service nova] Creating event network-vif-deleted:2de437f3-6471-40fa-99d7-87ecd143c0cb for instance 19586bdb-46bd-4857-aec4-1fac4419d56f on hv-cinder-84684 Jun 30 04:28:15.028429 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-72f20584-ac41-4c81-92cf-a74907915f6d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:15.033495 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-31a7ff77-c810-45d3-937c-12328e8a515b req-7353f716-ab84-4150-b8af-77e8d15141bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035877 Jun 30 04:28:15.037783 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 499/1019] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:15.113767 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-72f20584-ac41-4c81-92cf-a74907915f6d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:15.122946 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-72f20584-ac41-4c81-92cf-a74907915f6d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 200 len: 1327 microversion: 2.1 time: 0.112517 Jun 30 04:28:15.129245 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 521/1020] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:15 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:16.146147 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-929be60d-ea3c-4bed-b3f2-5fe3cef89025 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:16.147172 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-929be60d-ea3c-4bed-b3f2-5fe3cef89025 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:16.157077 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-929be60d-ea3c-4bed-b3f2-5fe3cef89025 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:16.157520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-929be60d-ea3c-4bed-b3f2-5fe3cef89025 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:16.158279 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-929be60d-ea3c-4bed-b3f2-5fe3cef89025 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:16.158710 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-929be60d-ea3c-4bed-b3f2-5fe3cef89025 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:16.172997 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-929be60d-ea3c-4bed-b3f2-5fe3cef89025 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-929be60d-ea3c-4bed-b3f2-5fe3cef89025 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f HTTP/1.1 Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:28:16.174597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:28:16.176061 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '19586bdb-46bd-4857-aec4-1fac4419d56f'} Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:28:16.176843 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:28:16.178107 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:28:16.179315 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-929be60d-ea3c-4bed-b3f2-5fe3cef89025 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:28:16.179315 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-929be60d-ea3c-4bed-b3f2-5fe3cef89025 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 404 len: 111 microversion: 2.1 time: 0.037756 Jun 30 04:28:16.179315 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 500/1021] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:16 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:28:16.185205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-7cd110e9-3b9b-4157-b2b0-7c2e8f5298a5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '.version_select at 0x7fb48017b5e0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:16.204914 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-7cd110e9-3b9b-4157-b2b0-7c2e8f5298a5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488768222" status: 202 len: 0 microversion: 2.1 time: 0.023612 Jun 30 04:28:16.205480 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 522/1022] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 30 04:28:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488768222 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:28:16.842093 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d1cdc076-6df9-4380-a1b7-ca908cb0f78a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: .version_select at 0x7fb480372790>, body: {"keypair": {"name": "tempest-keypair-1567880718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmcoWb5oEEI4Rgl3+hIE5So03CsHz0NB2FMVJNeFAhRZ/6weS9JL6P4k86aKND9zGZebOyN39gH7MnFTAzN4+K7a7mVMFHiXAs/lvjbcJzU6Ulw3AqtuU74SGPccRuDrA=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:28:16.857590 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-d1cdc076-6df9-4380-a1b7-ca908cb0f78a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:28:16.861932 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-d1cdc076-6df9-4380-a1b7-ca908cb0f78a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for user cab10b29f56246d1af122cfcbe20b2a6 and project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:28:16.887605 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d1cdc076-6df9-4380-a1b7-ca908cb0f78a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049404 Jun 30 04:28:16.888188 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 501/1023] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 30 04:28:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:18.227360 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1516431347", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20ab151a-92d3-45f8-9aea-acc5912ac287"}], "security_groups": [{"name": "tempest-securitygroup--406681320"}], "key_name": "tempest-keypair-1567880718", "user_data": "}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:28:18.331985 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.network.neutron [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] validate_networks() for [('20ab151a-92d3-45f8-9aea-acc5912ac287', None, None, None, None, None)] {{(pid=118188) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:28:18.715159 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Flavor limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:28:18.715876 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Image limits 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:28:18.716646 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Flavor pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:28:18.717221 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Image pref 0:0:0 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:28:18.717659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.virt.hardware [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118188) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:28:18.727273 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:18.727721 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:18.728525 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:18.728963 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:18.746221 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:28:18.750223 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for user cab10b29f56246d1af122cfcbe20b2a6 and project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'ram', 'cores', 'instances'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:28:18.761731 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Going to run 1 instances... {{(pid=118188) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:28:18.764104 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118188) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:28:18.819600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-31374f0c-9a44-460d-a985-03b4f5a5b7fe tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.596605 Jun 30 04:28:18.820228 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 523/1024] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:28:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:28:18.830721 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-87268e09-3337-49ef-914e-b2db3de8f566 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:18.831364 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-87268e09-3337-49ef-914e-b2db3de8f566 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:18.890577 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-87268e09-3337-49ef-914e-b2db3de8f566 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:18.898783 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-87268e09-3337-49ef-914e-b2db3de8f566 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1242 microversion: 2.1 time: 0.072054 Jun 30 04:28:18.899387 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 502/1025] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:18 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:19.916389 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-afbf0e97-ef2e-4a6d-abe3-dac53ef4442b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:19.917038 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-afbf0e97-ef2e-4a6d-abe3-dac53ef4442b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:19.924627 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-afbf0e97-ef2e-4a6d-abe3-dac53ef4442b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:19.925075 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-afbf0e97-ef2e-4a6d-abe3-dac53ef4442b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:19.925846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-afbf0e97-ef2e-4a6d-abe3-dac53ef4442b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:19.926275 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-afbf0e97-ef2e-4a6d-abe3-dac53ef4442b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:20.091221 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-afbf0e97-ef2e-4a6d-abe3-dac53ef4442b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:20.099690 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-afbf0e97-ef2e-4a6d-abe3-dac53ef4442b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1300 microversion: 2.1 time: 0.187770 Jun 30 04:28:20.100265 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 524/1026] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:19 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1300 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:21.117817 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-680af8ed-5b3e-4908-850e-ac17d9b1076b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:21.118433 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-680af8ed-5b3e-4908-850e-ac17d9b1076b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:21.125417 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-680af8ed-5b3e-4908-850e-ac17d9b1076b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:21.125872 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-680af8ed-5b3e-4908-850e-ac17d9b1076b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:21.126643 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-680af8ed-5b3e-4908-850e-ac17d9b1076b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:21.127077 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-680af8ed-5b3e-4908-850e-ac17d9b1076b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:21.347017 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-680af8ed-5b3e-4908-850e-ac17d9b1076b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:21.355725 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-680af8ed-5b3e-4908-850e-ac17d9b1076b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1367 microversion: 2.1 time: 0.241926 Jun 30 04:28:21.356515 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 503/1027] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:21 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:21.491991 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-30cbea9e-d593-45b1-af3d-cd0e094e9600 req-903f788c-3546-495f-adb3-171b8f794aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70fc4c34-f299-4e7b-9f46-9abcb4d40368", "tag": "582b71f3-d4fb-4f3e-bbb7-e9296ac5f139"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:28:21.505588 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-30cbea9e-d593-45b1-af3d-cd0e094e9600 req-903f788c-3546-495f-adb3-171b8f794aa4 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:21.506437 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-30cbea9e-d593-45b1-af3d-cd0e094e9600 req-903f788c-3546-495f-adb3-171b8f794aa4 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:21.528153 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-30cbea9e-d593-45b1-af3d-cd0e094e9600 req-903f788c-3546-495f-adb3-171b8f794aa4 service nova] Creating event network-changed:582b71f3-d4fb-4f3e-bbb7-e9296ac5f139 for instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 on hv-cinder-84684 Jun 30 04:28:21.534138 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-30cbea9e-d593-45b1-af3d-cd0e094e9600 req-903f788c-3546-495f-adb3-171b8f794aa4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048307 Jun 30 04:28:21.534785 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 525/1028] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:22.375992 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fadc909f-6637-470c-8795-85724e687bb1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:22.376641 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fadc909f-6637-470c-8795-85724e687bb1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:22.384221 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fadc909f-6637-470c-8795-85724e687bb1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:22.384723 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fadc909f-6637-470c-8795-85724e687bb1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:22.385605 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fadc909f-6637-470c-8795-85724e687bb1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:22.386088 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fadc909f-6637-470c-8795-85724e687bb1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:22.521623 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fadc909f-6637-470c-8795-85724e687bb1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:22.529099 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fadc909f-6637-470c-8795-85724e687bb1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1367 microversion: 2.1 time: 0.158862 Jun 30 04:28:22.529790 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 504/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:22 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:23.547425 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c5cb568c-a11c-4b94-9c55-8b053f3358ed tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:23.548153 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c5cb568c-a11c-4b94-9c55-8b053f3358ed tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:23.554709 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c5cb568c-a11c-4b94-9c55-8b053f3358ed tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:23.555198 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c5cb568c-a11c-4b94-9c55-8b053f3358ed tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:23.555948 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c5cb568c-a11c-4b94-9c55-8b053f3358ed tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:23.556973 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c5cb568c-a11c-4b94-9c55-8b053f3358ed tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:23.692740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c5cb568c-a11c-4b94-9c55-8b053f3358ed tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:23.703679 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c5cb568c-a11c-4b94-9c55-8b053f3358ed tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1367 microversion: 2.1 time: 0.160928 Jun 30 04:28:23.704394 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 526/1030] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:23 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:24.729698 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-82ba7423-58c4-4fde-a21d-89e29b6aaac1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:24.730701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-82ba7423-58c4-4fde-a21d-89e29b6aaac1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:24.742219 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82ba7423-58c4-4fde-a21d-89e29b6aaac1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:24.742969 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82ba7423-58c4-4fde-a21d-89e29b6aaac1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:24.744288 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82ba7423-58c4-4fde-a21d-89e29b6aaac1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:24.745019 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82ba7423-58c4-4fde-a21d-89e29b6aaac1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:24.886533 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-82ba7423-58c4-4fde-a21d-89e29b6aaac1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:24.894418 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-82ba7423-58c4-4fde-a21d-89e29b6aaac1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1367 microversion: 2.1 time: 0.171438 Jun 30 04:28:24.894993 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 505/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:24 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:25.220046 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-8f64158a-08c4-447f-8fb0-c1c1006430eb req-decbbbeb-988d-44db-89ec-b5d6ff45a625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70fc4c34-f299-4e7b-9f46-9abcb4d40368", "name": "network-vif-plugged", "status": "completed", "tag": "582b71f3-d4fb-4f3e-bbb7-e9296ac5f139"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:28:25.230157 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-8f64158a-08c4-447f-8fb0-c1c1006430eb req-decbbbeb-988d-44db-89ec-b5d6ff45a625 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:25.230593 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-8f64158a-08c4-447f-8fb0-c1c1006430eb req-decbbbeb-988d-44db-89ec-b5d6ff45a625 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:25.244039 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-8f64158a-08c4-447f-8fb0-c1c1006430eb req-decbbbeb-988d-44db-89ec-b5d6ff45a625 service nova] Creating event network-vif-plugged:582b71f3-d4fb-4f3e-bbb7-e9296ac5f139 for instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 on hv-cinder-84684 Jun 30 04:28:25.249301 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-8f64158a-08c4-447f-8fb0-c1c1006430eb req-decbbbeb-988d-44db-89ec-b5d6ff45a625 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033293 Jun 30 04:28:25.249890 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 527/1032] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:25.915322 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-56808c5b-2d65-4db5-922e-26be71446d61 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:25.916765 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-56808c5b-2d65-4db5-922e-26be71446d61 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:25.928711 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56808c5b-2d65-4db5-922e-26be71446d61 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:25.929463 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56808c5b-2d65-4db5-922e-26be71446d61 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:25.930731 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56808c5b-2d65-4db5-922e-26be71446d61 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:25.931533 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56808c5b-2d65-4db5-922e-26be71446d61 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:26.083014 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-56808c5b-2d65-4db5-922e-26be71446d61 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:26.090842 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-56808c5b-2d65-4db5-922e-26be71446d61 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1367 microversion: 2.1 time: 0.182123 Jun 30 04:28:26.091464 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 506/1033] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:25 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:27.111611 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-43740d61-442b-4b01-9fff-2da9555f0b81 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:27.112293 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-43740d61-442b-4b01-9fff-2da9555f0b81 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:27.119517 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-43740d61-442b-4b01-9fff-2da9555f0b81 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:27.119965 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-43740d61-442b-4b01-9fff-2da9555f0b81 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:27.120735 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-43740d61-442b-4b01-9fff-2da9555f0b81 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:27.121170 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-43740d61-442b-4b01-9fff-2da9555f0b81 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:27.261466 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-43740d61-442b-4b01-9fff-2da9555f0b81 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:28:27.269258 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-43740d61-442b-4b01-9fff-2da9555f0b81 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1558 microversion: 2.1 time: 0.162679 Jun 30 04:28:27.269831 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 528/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:28:27 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:28:27.285984 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-15a26af0-d8fe-478e-9d0e-642a02d6b9ad tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:27.286540 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-15a26af0-d8fe-478e-9d0e-642a02d6b9ad tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:27.293738 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-15a26af0-d8fe-478e-9d0e-642a02d6b9ad tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:27.294192 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-15a26af0-d8fe-478e-9d0e-642a02d6b9ad tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:27.295076 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-15a26af0-d8fe-478e-9d0e-642a02d6b9ad tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:27.295638 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-15a26af0-d8fe-478e-9d0e-642a02d6b9ad tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:27.378949 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-15a26af0-d8fe-478e-9d0e-642a02d6b9ad tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096552 Jun 30 04:28:27.380197 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 507/1035] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 30 04:28:27 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:28.329635 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-96d5d9f4-2856-4315-9a1f-aa4374b7f65e req-8e991a71-63ce-4950-a044-dcd329b0fef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70fc4c34-f299-4e7b-9f46-9abcb4d40368", "tag": "582b71f3-d4fb-4f3e-bbb7-e9296ac5f139"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:28:28.338359 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-96d5d9f4-2856-4315-9a1f-aa4374b7f65e req-8e991a71-63ce-4950-a044-dcd329b0fef1 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:28.338794 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-96d5d9f4-2856-4315-9a1f-aa4374b7f65e req-8e991a71-63ce-4950-a044-dcd329b0fef1 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:28.353180 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-96d5d9f4-2856-4315-9a1f-aa4374b7f65e req-8e991a71-63ce-4950-a044-dcd329b0fef1 service nova] Creating event network-changed:582b71f3-d4fb-4f3e-bbb7-e9296ac5f139 for instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 on hv-cinder-84684 Jun 30 04:28:28.358301 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-96d5d9f4-2856-4315-9a1f-aa4374b7f65e req-8e991a71-63ce-4950-a044-dcd329b0fef1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032416 Jun 30 04:28:28.358810 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 529/1036] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:57.855872 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:57.857143 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:57.858146 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:57.864464 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3b277c04-123b-4d04-a8d6-8f5baaf5f84b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:28:57.865259 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3b277c04-123b-4d04-a8d6-8f5baaf5f84b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:57.874036 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b277c04-123b-4d04-a8d6-8f5baaf5f84b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:57.874528 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b277c04-123b-4d04-a8d6-8f5baaf5f84b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:57.875287 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b277c04-123b-4d04-a8d6-8f5baaf5f84b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:57.875713 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b277c04-123b-4d04-a8d6-8f5baaf5f84b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:57.899979 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3b277c04-123b-4d04-a8d6-8f5baaf5f84b tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/ips" status: 200 len: 151 microversion: 2.1 time: 0.046985 Jun 30 04:28:57.900534 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 508/1037] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 30 04:28:57 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:28:59.281672 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:59.282459 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=6 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:59.283828 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:59.284553 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:28:59.289757 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a7c698fd-31da-4f8c-9bde-d8f3c48f6918 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b048ba55-41a8-4ee1-a992-42e92bfec00e"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:28:59.290925 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a7c698fd-31da-4f8c-9bde-d8f3c48f6918 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:28:59.301066 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a7c698fd-31da-4f8c-9bde-d8f3c48f6918 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:59.301507 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a7c698fd-31da-4f8c-9bde-d8f3c48f6918 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:59.302247 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a7c698fd-31da-4f8c-9bde-d8f3c48f6918 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:28:59.302672 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a7c698fd-31da-4f8c-9bde-d8f3c48f6918 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:28:59.555783 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a7c698fd-31da-4f8c-9bde-d8f3c48f6918 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274573 Jun 30 04:28:59.556539 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 530/1038] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:28:59 2022] POST /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:29:06.040827 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cac7d2bb-ab7e-4ea8-8fe2-11ca92443d84 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b048ba55-41a8-4ee1-a992-42e92bfec00e"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:29:06.041903 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-cac7d2bb-ab7e-4ea8-8fe2-11ca92443d84 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:06.048874 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cac7d2bb-ab7e-4ea8-8fe2-11ca92443d84 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:06.049323 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cac7d2bb-ab7e-4ea8-8fe2-11ca92443d84 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:06.050083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cac7d2bb-ab7e-4ea8-8fe2-11ca92443d84 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:06.050514 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cac7d2bb-ab7e-4ea8-8fe2-11ca92443d84 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:06.133004 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-cac7d2bb-ab7e-4ea8-8fe2-11ca92443d84 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Invalid volume: volume b048ba55-41a8-4ee1-a992-42e92bfec00e is already attached to instances: 70fc4c34-f299-4e7b-9f46-9abcb4d40368 Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cac7d2bb-ab7e-4ea8-8fe2-11ca92443d84 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: POST /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments HTTP/1.1 Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 74 Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:29:06.134628 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {"volumeAttachment": {"volumeId": "b048ba55-41a8-4ee1-a992-42e92bfec00e"}} Jun 30 04:29:06.136233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Invalid volume: volume b048ba55-41a8-4ee1-a992-42e92bfec00e is already attached to instances: 70fc4c34-f299-4e7b-9f46-9abcb4d40368 Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'server_id': '70fc4c34-f299-4e7b-9f46-9abcb4d40368', 'body': {'volumeAttachment': {'volumeId': 'b048ba55-41a8-4ee1-a992-42e92bfec00e'}}} Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b048ba55-41a8-4ee1-a992-42e92bfec00e is already attached to instances: 70fc4c34-f299-4e7b-9f46-9abcb4d40368 Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:29:06.137035 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b048ba55-41a8-4ee1-a992-42e92bfec00e is already attached to instances: 70fc4c34-f299-4e7b-9f46-9abcb4d40368 Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:29:06.138889 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:29:06.140478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:29:06.140478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:29:06.140478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:29:06.140478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b048ba55-41a8-4ee1-a992-42e92bfec00e is already attached to instances: 70fc4c34-f299-4e7b-9f46-9abcb4d40368 Jun 30 04:29:06.140478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:29:06.140478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cac7d2bb-ab7e-4ea8-8fe2-11ca92443d84 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 400 to user: Invalid volume: volume b048ba55-41a8-4ee1-a992-42e92bfec00e is already attached to instances: 70fc4c34-f299-4e7b-9f46-9abcb4d40368 {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:29:06.140478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cac7d2bb-ab7e-4ea8-8fe2-11ca92443d84 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099391 Jun 30 04:29:06.140478 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 509/1039] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:29:06 2022] POST /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 04:29:06.205309 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-625d06d7-0d46-4be2-9ffd-b66fedbf0332 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:06.205868 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-625d06d7-0d46-4be2-9ffd-b66fedbf0332 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:06.212869 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-625d06d7-0d46-4be2-9ffd-b66fedbf0332 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:06.213284 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-625d06d7-0d46-4be2-9ffd-b66fedbf0332 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:06.214065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-625d06d7-0d46-4be2-9ffd-b66fedbf0332 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:06.214494 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-625d06d7-0d46-4be2-9ffd-b66fedbf0332 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:06.304198 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.objects.instance [None req-625d06d7-0d46-4be2-9ffd-b66fedbf0332 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lazy-loading 'services' on Instance uuid 70fc4c34-f299-4e7b-9f46-9abcb4d40368 {{(pid=118188) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:29:06.380140 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-625d06d7-0d46-4be2-9ffd-b66fedbf0332 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments/b048ba55-41a8-4ee1-a992-42e92bfec00e" status: 202 len: 0 microversion: 2.1 time: 0.178904 Jun 30 04:29:06.380939 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 531/1040] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:29:06 2022] DELETE /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments/b048ba55-41a8-4ee1-a992-42e92bfec00e => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:29:06.390424 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9494cba6-0581-4f54-b13b-d54fb8d163f4 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:06.391403 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9494cba6-0581-4f54-b13b-d54fb8d163f4 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:06.398748 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9494cba6-0581-4f54-b13b-d54fb8d163f4 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:06.399258 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9494cba6-0581-4f54-b13b-d54fb8d163f4 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:06.400085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9494cba6-0581-4f54-b13b-d54fb8d163f4 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:06.400592 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9494cba6-0581-4f54-b13b-d54fb8d163f4 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:06.437352 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9494cba6-0581-4f54-b13b-d54fb8d163f4 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051155 Jun 30 04:29:06.438207 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 510/1041] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:29:06 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:29:07.459014 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a720d655-48f5-4101-9482-8bcda19c0181 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:07.460675 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a720d655-48f5-4101-9482-8bcda19c0181 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:07.470018 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a720d655-48f5-4101-9482-8bcda19c0181 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:07.470473 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a720d655-48f5-4101-9482-8bcda19c0181 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:07.471278 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a720d655-48f5-4101-9482-8bcda19c0181 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:07.471711 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a720d655-48f5-4101-9482-8bcda19c0181 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:07.501045 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a720d655-48f5-4101-9482-8bcda19c0181 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053298 Jun 30 04:29:07.501602 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 532/1042] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:29:07 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 04:29:07.563196 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3123469a-f5ad-46ef-85dc-8a2fcd7af7e6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:07.563723 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3123469a-f5ad-46ef-85dc-8a2fcd7af7e6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:07.570986 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3123469a-f5ad-46ef-85dc-8a2fcd7af7e6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:07.571585 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3123469a-f5ad-46ef-85dc-8a2fcd7af7e6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:07.572371 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3123469a-f5ad-46ef-85dc-8a2fcd7af7e6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:07.572803 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3123469a-f5ad-46ef-85dc-8a2fcd7af7e6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:07.601258 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3123469a-f5ad-46ef-85dc-8a2fcd7af7e6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:29:07.681893 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3123469a-f5ad-46ef-85dc-8a2fcd7af7e6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 204 len: 0 microversion: 2.1 time: 0.122299 Jun 30 04:29:07.682598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 511/1043] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:29:07 2022] DELETE /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:29:07.691152 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-b031dd63-35d0-4d48-993a-d9cf71007c56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:07.691760 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-b031dd63-35d0-4d48-993a-d9cf71007c56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:07.698161 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b031dd63-35d0-4d48-993a-d9cf71007c56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:07.698599 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b031dd63-35d0-4d48-993a-d9cf71007c56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:07.699387 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b031dd63-35d0-4d48-993a-d9cf71007c56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:07.699808 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-b031dd63-35d0-4d48-993a-d9cf71007c56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:07.838397 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-b031dd63-35d0-4d48-993a-d9cf71007c56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:29:07.846309 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-b031dd63-35d0-4d48-993a-d9cf71007c56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1683 microversion: 2.1 time: 0.159338 Jun 30 04:29:07.846890 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 533/1044] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:07 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:29:08.866052 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1b05835d-c14e-45f7-b64f-bc83824479e5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:08.866834 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1b05835d-c14e-45f7-b64f-bc83824479e5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:08.875131 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b05835d-c14e-45f7-b64f-bc83824479e5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:08.875721 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b05835d-c14e-45f7-b64f-bc83824479e5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:08.876659 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b05835d-c14e-45f7-b64f-bc83824479e5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:08.877091 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b05835d-c14e-45f7-b64f-bc83824479e5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:09.012051 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1b05835d-c14e-45f7-b64f-bc83824479e5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:29:09.022774 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1b05835d-c14e-45f7-b64f-bc83824479e5 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1683 microversion: 2.1 time: 0.161536 Jun 30 04:29:09.023433 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 512/1045] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:08 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:29:10.040376 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-8f1a136b-d6cd-40b7-8635-d3593e030cc0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:10.041094 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-8f1a136b-d6cd-40b7-8635-d3593e030cc0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:10.048392 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f1a136b-d6cd-40b7-8635-d3593e030cc0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:10.048842 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f1a136b-d6cd-40b7-8635-d3593e030cc0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:10.049590 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f1a136b-d6cd-40b7-8635-d3593e030cc0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:10.050045 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-8f1a136b-d6cd-40b7-8635-d3593e030cc0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:10.123034 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-8f1a136b-d6cd-40b7-8635-d3593e030cc0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:29:10.131364 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-8f1a136b-d6cd-40b7-8635-d3593e030cc0 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 200 len: 1616 microversion: 2.1 time: 0.094879 Jun 30 04:29:10.131970 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 534/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:10 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 1616 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:29:10.302349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-6c3617c1-3f21-4eed-aebc-8789a74479f3 req-330fc677-6e4e-4d04-8d1d-6673a1e05495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70fc4c34-f299-4e7b-9f46-9abcb4d40368", "name": "network-vif-deleted", "tag": "582b71f3-d4fb-4f3e-bbb7-e9296ac5f139"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:29:10.312413 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-6c3617c1-3f21-4eed-aebc-8789a74479f3 req-330fc677-6e4e-4d04-8d1d-6673a1e05495 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:10.313407 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-6c3617c1-3f21-4eed-aebc-8789a74479f3 req-330fc677-6e4e-4d04-8d1d-6673a1e05495 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:10.325901 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-6c3617c1-3f21-4eed-aebc-8789a74479f3 req-330fc677-6e4e-4d04-8d1d-6673a1e05495 service nova] Creating event network-vif-deleted:582b71f3-d4fb-4f3e-bbb7-e9296ac5f139 for instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 on hv-cinder-84684 Jun 30 04:29:10.331941 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-6c3617c1-3f21-4eed-aebc-8789a74479f3 req-330fc677-6e4e-4d04-8d1d-6673a1e05495 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032976 Jun 30 04:29:10.337362 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 513/1047] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:29:11.148993 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-267d10b9-c09c-4b92-8435-2d4ef564cf79 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:11.149563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-267d10b9-c09c-4b92-8435-2d4ef564cf79 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:11.156719 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-267d10b9-c09c-4b92-8435-2d4ef564cf79 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:11.157167 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-267d10b9-c09c-4b92-8435-2d4ef564cf79 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:11.157899 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-267d10b9-c09c-4b92-8435-2d4ef564cf79 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:11.158541 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-267d10b9-c09c-4b92-8435-2d4ef564cf79 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:11.172698 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-267d10b9-c09c-4b92-8435-2d4ef564cf79 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-267d10b9-c09c-4b92-8435-2d4ef564cf79 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 HTTP/1.1 Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:29:11.174385 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:29:11.176102 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '70fc4c34-f299-4e7b-9f46-9abcb4d40368'} Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:29:11.176960 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:29:11.178523 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:29:11.180053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-267d10b9-c09c-4b92-8435-2d4ef564cf79 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:29:11.180053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-267d10b9-c09c-4b92-8435-2d4ef564cf79 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 404 len: 111 microversion: 2.1 time: 0.031224 Jun 30 04:29:11.180053 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 535/1048] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:11 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:29:11.185801 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-36c11f00-db19-4cae-a1bb-b6327fc42425 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '.version_select at 0x7fb48010a310>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:11.206083 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-36c11f00-db19-4cae-a1bb-b6327fc42425 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567880718" status: 202 len: 0 microversion: 2.1 time: 0.024534 Jun 30 04:29:11.206664 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 514/1049] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 30 04:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567880718 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:29:11.843413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f4fd5b49-13e7-4802-9f3d-2bf43c984ea8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: .version_select at 0x7fb47b7d6f70>, body: {"keypair": {"name": "tempest-keypair-386872120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6+eWfTRFh9EWdRkHkJbOtm3xFdPcuW+C5HIWEx50zahEjWhbGbo8dTHAcPapG4ZzY/ybM5+FrOYL3BatZRKsaA2VSoyHzOIgnqB52/4nuCmV+aG1I4lMdvDjN2w2x/w=="}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:29:11.857406 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-f4fd5b49-13e7-4802-9f3d-2bf43c984ea8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:29:11.861271 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.quota [None req-f4fd5b49-13e7-4802-9f3d-2bf43c984ea8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for user cab10b29f56246d1af122cfcbe20b2a6 and project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'key_pairs'} {{(pid=118188) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:29:11.886455 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f4fd5b49-13e7-4802-9f3d-2bf43c984ea8 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049725 Jun 30 04:29:11.887038 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 536/1050] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 30 04:29:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:29:13.190676 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2039572643", "imageRef": "2334bf06-9418-43e0-ba41-987221104820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20ab151a-92d3-45f8-9aea-acc5912ac287"}], "security_groups": [{"name": "tempest-securitygroup--1281535714"}], "key_name": "tempest-keypair-386872120", "user_data": "}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:29:13.304157 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] validate_networks() for [('20ab151a-92d3-45f8-9aea-acc5912ac287', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 04:29:13.691926 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 04:29:13.692353 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 04:29:13.692808 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 04:29:13.693243 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 04:29:13.693661 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 04:29:13.703924 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:13.704397 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:13.705195 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:13.705629 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:13.723134 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 04:29:13.727607 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Getting quotas for user cab10b29f56246d1af122cfcbe20b2a6 and project 21b8001d268445c0a28c3ed02b9afcb3. Resources: {'ram', 'cores', 'instances'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 04:29:13.740408 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 04:29:13.742789 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2334bf06-9418-43e0-ba41-987221104820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 04:29:13.792455 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-58c24467-5fb3-4852-bc13-3db171638ff7 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606697 Jun 30 04:29:13.796552 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 515/1051] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 30 04:29:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 04:29:13.804557 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c65a21bf-061b-4591-8c48-b8db4a420766 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:13.805169 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c65a21bf-061b-4591-8c48-b8db4a420766 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:13.863830 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c65a21bf-061b-4591-8c48-b8db4a420766 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:29:13.871434 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c65a21bf-061b-4591-8c48-b8db4a420766 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 200 len: 1241 microversion: 2.1 time: 0.071316 Jun 30 04:29:13.872616 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 537/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:13 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:29:14.889851 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5f22d6e1-ff1c-4822-b7fb-12a11af41c4d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:14.891020 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5f22d6e1-ff1c-4822-b7fb-12a11af41c4d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:14.898849 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f22d6e1-ff1c-4822-b7fb-12a11af41c4d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:14.899324 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f22d6e1-ff1c-4822-b7fb-12a11af41c4d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:14.900077 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f22d6e1-ff1c-4822-b7fb-12a11af41c4d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:14.900504 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f22d6e1-ff1c-4822-b7fb-12a11af41c4d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:14.983275 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5f22d6e1-ff1c-4822-b7fb-12a11af41c4d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:29:14.991811 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5f22d6e1-ff1c-4822-b7fb-12a11af41c4d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 200 len: 1299 microversion: 2.1 time: 0.106570 Jun 30 04:29:14.992388 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 516/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:14 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:29:16.009703 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-aadaa1c2-46c9-483c-8e22-49504ff95ffa tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:16.010295 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-aadaa1c2-46c9-483c-8e22-49504ff95ffa tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:16.018049 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aadaa1c2-46c9-483c-8e22-49504ff95ffa tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:16.018659 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aadaa1c2-46c9-483c-8e22-49504ff95ffa tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:16.019563 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aadaa1c2-46c9-483c-8e22-49504ff95ffa tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:16.020420 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-aadaa1c2-46c9-483c-8e22-49504ff95ffa tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:16.237655 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-aadaa1c2-46c9-483c-8e22-49504ff95ffa tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:29:16.245626 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-aadaa1c2-46c9-483c-8e22-49504ff95ffa tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 200 len: 1367 microversion: 2.1 time: 0.240229 Jun 30 04:29:16.246457 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 538/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:16 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 04:29:16.289432 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-cb270b4f-e45e-40af-b78d-19abe2f97b5a req-e156f169-3f49-477d-b96f-a559521ada72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824661d7-6a9d-44c0-b27d-4758339fb080", "tag": "b80604aa-08b3-406c-b858-2f68ee7c51b9"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:29:16.301657 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-cb270b4f-e45e-40af-b78d-19abe2f97b5a req-e156f169-3f49-477d-b96f-a559521ada72 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:16.302181 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-cb270b4f-e45e-40af-b78d-19abe2f97b5a req-e156f169-3f49-477d-b96f-a559521ada72 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:16.317718 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-cb270b4f-e45e-40af-b78d-19abe2f97b5a req-e156f169-3f49-477d-b96f-a559521ada72 service nova] Creating event network-changed:b80604aa-08b3-406c-b858-2f68ee7c51b9 for instance 824661d7-6a9d-44c0-b27d-4758339fb080 on hv-cinder-84684 Jun 30 04:29:16.323380 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-cb270b4f-e45e-40af-b78d-19abe2f97b5a req-e156f169-3f49-477d-b96f-a559521ada72 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039767 Jun 30 04:29:16.324455 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 517/1055] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:29:17.264182 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-df8435a6-75f5-456f-943a-268f6265717c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:17.264758 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-df8435a6-75f5-456f-943a-268f6265717c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:17.272411 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df8435a6-75f5-456f-943a-268f6265717c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:17.272856 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df8435a6-75f5-456f-943a-268f6265717c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:17.273625 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df8435a6-75f5-456f-943a-268f6265717c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:17.274052 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-df8435a6-75f5-456f-943a-268f6265717c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:17.481870 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-df8435a6-75f5-456f-943a-268f6265717c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:29:17.490944 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-df8435a6-75f5-456f-943a-268f6265717c tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 200 len: 1367 microversion: 2.1 time: 0.230657 Jun 30 04:29:17.498789 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 539/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:17 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:29:18.512590 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8213019d-7f3e-4036-9c39-4351d0db68b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:18.514056 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8213019d-7f3e-4036-9c39-4351d0db68b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:18.526863 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8213019d-7f3e-4036-9c39-4351d0db68b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:18.527726 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8213019d-7f3e-4036-9c39-4351d0db68b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:18.529164 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8213019d-7f3e-4036-9c39-4351d0db68b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:18.529938 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8213019d-7f3e-4036-9c39-4351d0db68b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:18.674013 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8213019d-7f3e-4036-9c39-4351d0db68b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:29:18.685409 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8213019d-7f3e-4036-9c39-4351d0db68b9 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 200 len: 1367 microversion: 2.1 time: 0.179732 Jun 30 04:29:18.686171 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 518/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:18 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:29:19.573983 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-45788edb-134c-4fae-9d36-d5f6ad2a700c req-373bc426-83af-4639-a288-81e82d9bce06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824661d7-6a9d-44c0-b27d-4758339fb080", "name": "network-vif-plugged", "status": "completed", "tag": "b80604aa-08b3-406c-b858-2f68ee7c51b9"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:29:19.584318 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-45788edb-134c-4fae-9d36-d5f6ad2a700c req-373bc426-83af-4639-a288-81e82d9bce06 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:19.584849 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-45788edb-134c-4fae-9d36-d5f6ad2a700c req-373bc426-83af-4639-a288-81e82d9bce06 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:19.596645 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-45788edb-134c-4fae-9d36-d5f6ad2a700c req-373bc426-83af-4639-a288-81e82d9bce06 service nova] Creating event network-vif-plugged:b80604aa-08b3-406c-b858-2f68ee7c51b9 for instance 824661d7-6a9d-44c0-b27d-4758339fb080 on hv-cinder-84684 Jun 30 04:29:19.601698 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-45788edb-134c-4fae-9d36-d5f6ad2a700c req-373bc426-83af-4639-a288-81e82d9bce06 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031576 Jun 30 04:29:19.602290 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 540/1058] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:29:19.703924 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b42f7d11-6c53-42ee-9eb7-5ca4ecd030cb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:19.704545 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b42f7d11-6c53-42ee-9eb7-5ca4ecd030cb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:19.712047 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b42f7d11-6c53-42ee-9eb7-5ca4ecd030cb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:19.712495 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b42f7d11-6c53-42ee-9eb7-5ca4ecd030cb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:19.713458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b42f7d11-6c53-42ee-9eb7-5ca4ecd030cb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:19.713905 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b42f7d11-6c53-42ee-9eb7-5ca4ecd030cb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:19.895244 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b42f7d11-6c53-42ee-9eb7-5ca4ecd030cb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:29:19.903125 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b42f7d11-6c53-42ee-9eb7-5ca4ecd030cb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 200 len: 1367 microversion: 2.1 time: 0.203995 Jun 30 04:29:19.903692 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 519/1059] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:19 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:29:20.921669 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-55d475f6-e9a5-4702-987e-cf9e3f86c3eb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:20.922231 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-55d475f6-e9a5-4702-987e-cf9e3f86c3eb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:20.929261 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-55d475f6-e9a5-4702-987e-cf9e3f86c3eb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:20.929706 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-55d475f6-e9a5-4702-987e-cf9e3f86c3eb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:20.930458 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-55d475f6-e9a5-4702-987e-cf9e3f86c3eb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:20.930890 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-55d475f6-e9a5-4702-987e-cf9e3f86c3eb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:21.065799 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-55d475f6-e9a5-4702-987e-cf9e3f86c3eb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:29:21.076760 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-55d475f6-e9a5-4702-987e-cf9e3f86c3eb tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 200 len: 1557 microversion: 2.1 time: 0.159737 Jun 30 04:29:21.077488 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 541/1060] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:29:20 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:29:21.094185 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-172b4b17-20e2-41e6-b461-6101ac2716e3 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:21.094736 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-172b4b17-20e2-41e6-b461-6101ac2716e3 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:21.102005 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-172b4b17-20e2-41e6-b461-6101ac2716e3 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:21.102458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-172b4b17-20e2-41e6-b461-6101ac2716e3 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:21.103299 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-172b4b17-20e2-41e6-b461-6101ac2716e3 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:21.103733 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-172b4b17-20e2-41e6-b461-6101ac2716e3 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:21.189257 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-172b4b17-20e2-41e6-b461-6101ac2716e3 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098642 Jun 30 04:29:21.190315 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 520/1061] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 30 04:29:21 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 04:29:22.791069 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [req-00fde07f-2199-4b98-b2a9-93cc4f233c65 req-7acec5ac-ec7c-4f69-bdbc-985076db80a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824661d7-6a9d-44c0-b27d-4758339fb080", "tag": "b80604aa-08b3-406c-b858-2f68ee7c51b9"}]} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:29:22.800205 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-00fde07f-2199-4b98-b2a9-93cc4f233c65 req-7acec5ac-ec7c-4f69-bdbc-985076db80a5 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:22.800737 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [req-00fde07f-2199-4b98-b2a9-93cc4f233c65 req-7acec5ac-ec7c-4f69-bdbc-985076db80a5 service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:22.812116 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.compute.server_external_events [req-00fde07f-2199-4b98-b2a9-93cc4f233c65 req-7acec5ac-ec7c-4f69-bdbc-985076db80a5 service nova] Creating event network-changed:b80604aa-08b3-406c-b858-2f68ee7c51b9 for instance 824661d7-6a9d-44c0-b27d-4758339fb080 on hv-cinder-84684 Jun 30 04:29:22.817670 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [req-00fde07f-2199-4b98-b2a9-93cc4f233c65 req-7acec5ac-ec7c-4f69-bdbc-985076db80a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030306 Jun 30 04:29:22.818310 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 542/1062] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:29:56.976054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:29:56.977053 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:29:56.977995 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:29:56.978961 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:29:56.984636 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3b27f8da-b5db-42c4-96dc-7e48d9d293d1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:29:56.985304 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3b27f8da-b5db-42c4-96dc-7e48d9d293d1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:56.996795 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b27f8da-b5db-42c4-96dc-7e48d9d293d1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:56.997236 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b27f8da-b5db-42c4-96dc-7e48d9d293d1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:56.997985 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b27f8da-b5db-42c4-96dc-7e48d9d293d1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:56.998407 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b27f8da-b5db-42c4-96dc-7e48d9d293d1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:57.030812 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3b27f8da-b5db-42c4-96dc-7e48d9d293d1 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/ips" status: 200 len: 149 microversion: 2.1 time: 0.056823 Jun 30 04:29:57.031421 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 521/1063] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 30 04:29:56 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/ips => generated 149 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:29:58.401119 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell0:SELECT=6 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:29:58.402142 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:29:58.402908 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG dbcounter [-] [118188] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 04:29:58.407303 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-f816b986-758b-4505-a7eb-854150b43cfd tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6231982b-10ba-4f72-a12b-6f245e99bd07"}} {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:29:58.408457 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-f816b986-758b-4505-a7eb-854150b43cfd tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:29:58.416797 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f816b986-758b-4505-a7eb-854150b43cfd tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:58.417311 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f816b986-758b-4505-a7eb-854150b43cfd tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:58.418103 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f816b986-758b-4505-a7eb-854150b43cfd tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:29:58.418536 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-f816b986-758b-4505-a7eb-854150b43cfd tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:29:58.678043 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-f816b986-758b-4505-a7eb-854150b43cfd tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "POST /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279063 Jun 30 04:29:58.679152 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 543/1064] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 30 04:29:58 2022] POST /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:30:05.275961 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5f5bc116-bc75-4de5-93fa-9e95752c575d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:05.276496 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5f5bc116-bc75-4de5-93fa-9e95752c575d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:05.282913 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f5bc116-bc75-4de5-93fa-9e95752c575d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:05.283405 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f5bc116-bc75-4de5-93fa-9e95752c575d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:05.284180 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f5bc116-bc75-4de5-93fa-9e95752c575d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:05.284620 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f5bc116-bc75-4de5-93fa-9e95752c575d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:05.379461 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-5f5bc116-bc75-4de5-93fa-9e95752c575d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lazy-loading 'services' on Instance uuid 824661d7-6a9d-44c0-b27d-4758339fb080 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 04:30:05.476817 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5f5bc116-bc75-4de5-93fa-9e95752c575d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/os-volume_attachments/6231982b-10ba-4f72-a12b-6f245e99bd07" status: 202 len: 0 microversion: 2.1 time: 0.204335 Jun 30 04:30:05.477656 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 522/1065] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 30 04:30:05 2022] DELETE /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/os-volume_attachments/6231982b-10ba-4f72-a12b-6f245e99bd07 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:30:05.493331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-4b189b5d-6dd3-4b61-8862-04607fe71033 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:05.494559 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-4b189b5d-6dd3-4b61-8862-04607fe71033 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:05.502187 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b189b5d-6dd3-4b61-8862-04607fe71033 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:05.502874 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b189b5d-6dd3-4b61-8862-04607fe71033 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:05.503681 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b189b5d-6dd3-4b61-8862-04607fe71033 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:05.504131 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-4b189b5d-6dd3-4b61-8862-04607fe71033 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:05.536740 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-4b189b5d-6dd3-4b61-8862-04607fe71033 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052229 Jun 30 04:30:05.537319 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 544/1066] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:30:05 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:30:06.551621 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ef491886-ce2b-475c-9a6f-d1cbd5e61abc tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:06.552808 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ef491886-ce2b-475c-9a6f-d1cbd5e61abc tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:06.561144 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef491886-ce2b-475c-9a6f-d1cbd5e61abc tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:06.561713 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef491886-ce2b-475c-9a6f-d1cbd5e61abc tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:06.562579 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef491886-ce2b-475c-9a6f-d1cbd5e61abc tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:06.563016 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef491886-ce2b-475c-9a6f-d1cbd5e61abc tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:06.595066 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ef491886-ce2b-475c-9a6f-d1cbd5e61abc tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049663 Jun 30 04:30:06.595664 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 523/1067] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 30 04:30:06 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 04:30:06.654826 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-d8b1a0ec-2699-43f2-87e6-48db78982075 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:06.655381 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d8b1a0ec-2699-43f2-87e6-48db78982075 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:06.662541 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8b1a0ec-2699-43f2-87e6-48db78982075 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:06.662985 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8b1a0ec-2699-43f2-87e6-48db78982075 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:06.663808 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8b1a0ec-2699-43f2-87e6-48db78982075 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:06.664240 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-d8b1a0ec-2699-43f2-87e6-48db78982075 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:06.690870 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-d8b1a0ec-2699-43f2-87e6-48db78982075 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Going to try to terminate instance {{(pid=118188) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 04:30:06.773038 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-d8b1a0ec-2699-43f2-87e6-48db78982075 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 204 len: 0 microversion: 2.1 time: 0.121369 Jun 30 04:30:06.774188 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 545/1068] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:30:06 2022] DELETE /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 04:30:06.782597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f7f5e12b-1a39-4d23-a40f-844331013e56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:06.783227 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f7f5e12b-1a39-4d23-a40f-844331013e56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:06.789897 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f7f5e12b-1a39-4d23-a40f-844331013e56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:06.790336 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f7f5e12b-1a39-4d23-a40f-844331013e56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:06.791085 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f7f5e12b-1a39-4d23-a40f-844331013e56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:06.791543 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f7f5e12b-1a39-4d23-a40f-844331013e56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:06.927922 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f7f5e12b-1a39-4d23-a40f-844331013e56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:30:06.937057 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f7f5e12b-1a39-4d23-a40f-844331013e56 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 200 len: 1681 microversion: 2.1 time: 0.158253 Jun 30 04:30:06.937783 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 524/1069] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:30:06 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:30:07.961288 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-a3c44049-43d3-4aa3-8954-d11549b6eb03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:07.962442 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-a3c44049-43d3-4aa3-8954-d11549b6eb03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:07.972121 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a3c44049-43d3-4aa3-8954-d11549b6eb03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:07.972571 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a3c44049-43d3-4aa3-8954-d11549b6eb03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:07.973323 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a3c44049-43d3-4aa3-8954-d11549b6eb03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:07.973749 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-a3c44049-43d3-4aa3-8954-d11549b6eb03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:08.122634 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-a3c44049-43d3-4aa3-8954-d11549b6eb03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:30:08.130616 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-a3c44049-43d3-4aa3-8954-d11549b6eb03 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 200 len: 1681 microversion: 2.1 time: 0.177699 Jun 30 04:30:08.131246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 546/1070] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:30:07 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:30:09.137615 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-8ba47aa0-cfa7-4c3a-8904-68e91efa444d req-143079ac-c15e-45f9-a4d3-00eef26b3cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824661d7-6a9d-44c0-b27d-4758339fb080", "name": "network-vif-deleted", "tag": "b80604aa-08b3-406c-b858-2f68ee7c51b9"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 04:30:09.149233 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8ba47aa0-cfa7-4c3a-8904-68e91efa444d req-143079ac-c15e-45f9-a4d3-00eef26b3cbb service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:09.149844 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8ba47aa0-cfa7-4c3a-8904-68e91efa444d req-143079ac-c15e-45f9-a4d3-00eef26b3cbb service nova] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:09.149973 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-c84e76fb-16a9-43ed-a16f-891c2aeb7923 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:09.151211 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-c84e76fb-16a9-43ed-a16f-891c2aeb7923 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:09.159741 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c84e76fb-16a9-43ed-a16f-891c2aeb7923 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:09.160580 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c84e76fb-16a9-43ed-a16f-891c2aeb7923 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:09.162282 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c84e76fb-16a9-43ed-a16f-891c2aeb7923 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:09.163388 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-8ba47aa0-cfa7-4c3a-8904-68e91efa444d req-143079ac-c15e-45f9-a4d3-00eef26b3cbb service nova] Creating event network-vif-deleted:b80604aa-08b3-406c-b858-2f68ee7c51b9 for instance 824661d7-6a9d-44c0-b27d-4758339fb080 on hv-cinder-84684 Jun 30 04:30:09.169904 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-8ba47aa0-cfa7-4c3a-8904-68e91efa444d req-143079ac-c15e-45f9-a4d3-00eef26b3cbb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036106 Jun 30 04:30:09.170959 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 525/1071] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 30 04:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 04:30:09.171850 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-c84e76fb-16a9-43ed-a16f-891c2aeb7923 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:09.250365 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.policy [None req-c84e76fb-16a9-43ed-a16f-891c2aeb7923 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab10b29f56246d1af122cfcbe20b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8001d268445c0a28c3ed02b9afcb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118188) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 04:30:09.259232 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-c84e76fb-16a9-43ed-a16f-891c2aeb7923 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 200 len: 1326 microversion: 2.1 time: 0.115617 Jun 30 04:30:09.260301 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 547/1072] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:30:09 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 04:30:10.282516 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2fcb4ba6-b456-4397-acd0-b2f22a395bf6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:10.283248 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2fcb4ba6-b456-4397-acd0-b2f22a395bf6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:10.290045 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2fcb4ba6-b456-4397-acd0-b2f22a395bf6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:10.290486 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2fcb4ba6-b456-4397-acd0-b2f22a395bf6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:10.291354 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2fcb4ba6-b456-4397-acd0-b2f22a395bf6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:10.291763 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2fcb4ba6-b456-4397-acd0-b2f22a395bf6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:10.306102 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-2fcb4ba6-b456-4397-acd0-b2f22a395bf6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2fcb4ba6-b456-4397-acd0-b2f22a395bf6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 HTTP/1.1 Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:30:10.307883 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:10.309598 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '824661d7-6a9d-44c0-b27d-4758339fb080'} Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:30:10.310458 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:10.313160 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:10.315144 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2fcb4ba6-b456-4397-acd0-b2f22a395bf6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:30:10.315144 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2fcb4ba6-b456-4397-acd0-b2f22a395bf6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 404 len: 111 microversion: 2.1 time: 0.031821 Jun 30 04:30:10.315144 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 526/1073] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:30:10 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:30:10.320005 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-87941649-92d3-407d-9193-a99b68a83ce2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '.version_select at 0x7fb4800901f0>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:10.338087 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-87941649-92d3-407d-9193-a99b68a83ce2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386872120" status: 202 len: 0 microversion: 2.1 time: 0.023448 Jun 30 04:30:10.338638 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 548/1074] 10.222.0.13 () {58 vars in 1217 bytes} [Thu Jun 30 04:30:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386872120 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 04:30:12.390732 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f4b85939-7caa-40f3-8305-bc8c1a6c2a21 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:12.391284 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f4b85939-7caa-40f3-8305-bc8c1a6c2a21 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:12.398393 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4b85939-7caa-40f3-8305-bc8c1a6c2a21 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:12.398847 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4b85939-7caa-40f3-8305-bc8c1a6c2a21 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:12.399641 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4b85939-7caa-40f3-8305-bc8c1a6c2a21 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:12.400080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4b85939-7caa-40f3-8305-bc8c1a6c2a21 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:12.413597 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-f4b85939-7caa-40f3-8305-bc8c1a6c2a21 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f4b85939-7caa-40f3-8305-bc8c1a6c2a21 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 HTTP/1.1 Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:30:12.415170 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:12.416787 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '824661d7-6a9d-44c0-b27d-4758339fb080'} Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:30:12.417770 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:12.419337 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:12.428285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f4b85939-7caa-40f3-8305-bc8c1a6c2a21 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:30:12.428285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f4b85939-7caa-40f3-8305-bc8c1a6c2a21 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 404 len: 111 microversion: 2.1 time: 0.029805 Jun 30 04:30:12.428285 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 527/1075] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:30:12 2022] DELETE /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:30:12.428570 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-eb2406a9-9f24-4342-88a6-417043ea4939 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:12.428570 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-eb2406a9-9f24-4342-88a6-417043ea4939 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 824661d7-6a9d-44c0-b27d-4758339fb080] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:12.435331 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-eb2406a9-9f24-4342-88a6-417043ea4939 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:12.435863 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-eb2406a9-9f24-4342-88a6-417043ea4939 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:12.436834 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-eb2406a9-9f24-4342-88a6-417043ea4939 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:12.437697 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-eb2406a9-9f24-4342-88a6-417043ea4939 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:12.455246 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-eb2406a9-9f24-4342-88a6-417043ea4939 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-eb2406a9-9f24-4342-88a6-417043ea4939 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 HTTP/1.1 Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:30:12.457361 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:12.458977 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '824661d7-6a9d-44c0-b27d-4758339fb080'} Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:30:12.459866 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. Jun 30 04:30:12.461118 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:12.462492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-eb2406a9-9f24-4342-88a6-417043ea4939 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance 824661d7-6a9d-44c0-b27d-4758339fb080 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:30:12.462492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-eb2406a9-9f24-4342-88a6-417043ea4939 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080" status: 404 len: 111 microversion: 2.1 time: 0.037621 Jun 30 04:30:12.462492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 549/1076] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:30:12 2022] GET /compute/v2.1/servers/824661d7-6a9d-44c0-b27d-4758339fb080 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:30:13.595595 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f82e6040-dc4f-456c-81fa-fb2b3c143e42 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:13.596117 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f82e6040-dc4f-456c-81fa-fb2b3c143e42 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:13.602757 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f82e6040-dc4f-456c-81fa-fb2b3c143e42 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:13.603246 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f82e6040-dc4f-456c-81fa-fb2b3c143e42 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:13.604012 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f82e6040-dc4f-456c-81fa-fb2b3c143e42 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:13.604448 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f82e6040-dc4f-456c-81fa-fb2b3c143e42 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:13.618027 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-f82e6040-dc4f-456c-81fa-fb2b3c143e42 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f82e6040-dc4f-456c-81fa-fb2b3c143e42 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 HTTP/1.1 Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:30:13.619622 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:30:13.621238 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '70fc4c34-f299-4e7b-9f46-9abcb4d40368'} Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:30:13.622080 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:30:13.623701 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.625316 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f82e6040-dc4f-456c-81fa-fb2b3c143e42 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:30:13.625316 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f82e6040-dc4f-456c-81fa-fb2b3c143e42 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 404 len: 111 microversion: 2.1 time: 0.029520 Jun 30 04:30:13.625316 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 528/1077] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:30:13 2022] DELETE /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:30:13.629868 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-28c9e27d-999f-4806-a9b9-f7da0f66201a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:13.630502 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-28c9e27d-999f-4806-a9b9-f7da0f66201a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 70fc4c34-f299-4e7b-9f46-9abcb4d40368] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:13.637418 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-28c9e27d-999f-4806-a9b9-f7da0f66201a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:13.637851 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-28c9e27d-999f-4806-a9b9-f7da0f66201a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:13.638600 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-28c9e27d-999f-4806-a9b9-f7da0f66201a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:13.639019 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-28c9e27d-999f-4806-a9b9-f7da0f66201a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:13.653405 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-28c9e27d-999f-4806-a9b9-f7da0f66201a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-28c9e27d-999f-4806-a9b9-f7da0f66201a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 HTTP/1.1 Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:30:13.654950 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:30:13.656945 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '70fc4c34-f299-4e7b-9f46-9abcb4d40368'} Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:30:13.657846 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. Jun 30 04:30:13.659353 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.660681 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-28c9e27d-999f-4806-a9b9-f7da0f66201a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance 70fc4c34-f299-4e7b-9f46-9abcb4d40368 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:30:13.660681 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-28c9e27d-999f-4806-a9b9-f7da0f66201a tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368" status: 404 len: 111 microversion: 2.1 time: 0.030338 Jun 30 04:30:13.660681 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 550/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:30:13 2022] GET /compute/v2.1/servers/70fc4c34-f299-4e7b-9f46-9abcb4d40368 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:30:13.665510 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4c73b8de-2657-41ad-a807-24dc8abced2d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:13.666026 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4c73b8de-2657-41ad-a807-24dc8abced2d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:13.673381 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4c73b8de-2657-41ad-a807-24dc8abced2d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:13.673827 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4c73b8de-2657-41ad-a807-24dc8abced2d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:13.674627 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4c73b8de-2657-41ad-a807-24dc8abced2d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:13.675066 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4c73b8de-2657-41ad-a807-24dc8abced2d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:13.688967 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-4c73b8de-2657-41ad-a807-24dc8abced2d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4c73b8de-2657-41ad-a807-24dc8abced2d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 HTTP/1.1 Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:30:13.690520 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:30:13.692208 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': 'c41def07-cddb-4708-ac21-12522d278e62'} Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:30:13.693054 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:30:13.694349 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.695667 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4c73b8de-2657-41ad-a807-24dc8abced2d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:30:13.695667 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4c73b8de-2657-41ad-a807-24dc8abced2d tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 404 len: 111 microversion: 2.1 time: 0.030395 Jun 30 04:30:13.695667 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 529/1079] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:30:13 2022] DELETE /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:30:13.700985 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-663f29cf-8346-401a-ad96-78a45d3d1ec2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:13.701589 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-663f29cf-8346-401a-ad96-78a45d3d1ec2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: c41def07-cddb-4708-ac21-12522d278e62] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:13.708386 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-663f29cf-8346-401a-ad96-78a45d3d1ec2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:13.708822 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-663f29cf-8346-401a-ad96-78a45d3d1ec2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:13.709567 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-663f29cf-8346-401a-ad96-78a45d3d1ec2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:13.710100 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-663f29cf-8346-401a-ad96-78a45d3d1ec2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:13.723881 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-663f29cf-8346-401a-ad96-78a45d3d1ec2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-663f29cf-8346-401a-ad96-78a45d3d1ec2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 HTTP/1.1 Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:30:13.725413 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:30:13.727063 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': 'c41def07-cddb-4708-ac21-12522d278e62'} Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:30:13.727999 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. Jun 30 04:30:13.729492 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:13.730813 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-663f29cf-8346-401a-ad96-78a45d3d1ec2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance c41def07-cddb-4708-ac21-12522d278e62 could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:30:13.730813 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-663f29cf-8346-401a-ad96-78a45d3d1ec2 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62" status: 404 len: 111 microversion: 2.1 time: 0.029930 Jun 30 04:30:13.730813 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 551/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:30:13 2022] GET /compute/v2.1/servers/c41def07-cddb-4708-ac21-12522d278e62 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:30:14.882467 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b970da62-d7e1-45e5-b7a0-e7b1dd7d24a6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:14.882994 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b970da62-d7e1-45e5-b7a0-e7b1dd7d24a6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:14.889782 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b970da62-d7e1-45e5-b7a0-e7b1dd7d24a6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:14.890228 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b970da62-d7e1-45e5-b7a0-e7b1dd7d24a6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:14.890983 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b970da62-d7e1-45e5-b7a0-e7b1dd7d24a6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:14.891443 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b970da62-d7e1-45e5-b7a0-e7b1dd7d24a6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:14.905828 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-b970da62-d7e1-45e5-b7a0-e7b1dd7d24a6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b970da62-d7e1-45e5-b7a0-e7b1dd7d24a6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f HTTP/1.1 Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept: application/json Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Connection: close Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Host: 10.222.0.13 Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.9 Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jun 30 04:30:14.907488 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: method: > Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: exception: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:30:14.909031 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: action_args: {'id': '19586bdb-46bd-4857-aec4-1fac4419d56f'} Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:30:14.909946 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:30:14.911434 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jun 30 04:30:14.912942 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b970da62-d7e1-45e5-b7a0-e7b1dd7d24a6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:30:14.912942 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b970da62-d7e1-45e5-b7a0-e7b1dd7d24a6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "DELETE /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 404 len: 111 microversion: 2.1 time: 0.030318 Jun 30 04:30:14.912942 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 530/1081] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 30 04:30:14 2022] DELETE /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:30:14.917581 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1934354f-f23b-4c4b-b788-19de112f4df6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Calling method '>' {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 04:30:14.918196 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.compute.api [None req-1934354f-f23b-4c4b-b788-19de112f4df6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] [instance: 19586bdb-46bd-4857-aec4-1fac4419d56f] Fetching instance by UUID {{(pid=118188) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 04:30:14.925272 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1934354f-f23b-4c4b-b788-19de112f4df6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:14.925729 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1934354f-f23b-4c4b-b788-19de112f4df6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:14.926491 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1934354f-f23b-4c4b-b788-19de112f4df6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 04:30:14.926930 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG oslo_concurrency.lockutils [None req-1934354f-f23b-4c4b-b788-19de112f4df6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Lock "f0b3dfcb-6461-41ce-bb34-7ec7929e49fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 04:30:14.941509 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.wsgi [None req-1934354f-f23b-4c4b-b788-19de112f4df6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] HTTP exception thrown: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1934354f-f23b-4c4b-b788-19de112f4df6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Request method failure captured: Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: request: GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f HTTP/1.1 Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept: application/json Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Accept-Encoding: identity Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Connection: close Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Length: 0 Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Content-Type: application/json Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Host: 10.222.0.13 Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Openstack-System-Scope: None Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: User-Agent: python-urllib3/1.26.9 Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Auth-Token: gAAAAABivSXtHe7hsnYdoOEN2LSKRCuFGx_NNb5h9asdG47O2Rj-GdQsrqqC105tEqVWYmjP10CotN032hF0b1sddHNji-UrGtgulW85-kUlg8KPDT1emJo424FnQmITq3Na480Z-P0B5nxAvDJccjP8s23P06r7cuMdH0ikjAdTW8R5uBRXeIQ Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Id: None Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Domain-Name: None Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Identity-Status: Confirmed Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Is-Admin-Project: True Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Id: default Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Domain-Name: Default Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Project-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Role: reader,member Jun 30 04:30:14.943065 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Roles: reader,member Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21b8001d268445c0a28c3ed02b9afcb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21b8001d268445c0a28c3ed02b9afcb3"}]}] Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Id: 21b8001d268445c0a28c3ed02b9afcb3 Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362011095 Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Id: default Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Domain-Name: Default Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Id: cab10b29f56246d1af122cfcbe20b2a6 Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: X-User-Name: tempest-AttachVolumeNegativeTest-362011095-project Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: method: > Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: exception: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:30:14.945744 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: action_args: {'id': '19586bdb-46bd-4857-aec4-1fac4419d56f'} Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: {{(pid=118188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 04:30:14.946981 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. Jun 30 04:30:14.949146 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: ERROR nova.api.openstack.wsgi Jun 30 04:30:14.950728 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: DEBUG nova.api.openstack.wsgi [None req-1934354f-f23b-4c4b-b788-19de112f4df6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] Returning 404 to user: Instance 19586bdb-46bd-4857-aec4-1fac4419d56f could not be found. {{(pid=118188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 04:30:14.950728 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO nova.api.openstack.requestlog [None req-1934354f-f23b-4c4b-b788-19de112f4df6 tempest-AttachVolumeNegativeTest-362011095 tempest-AttachVolumeNegativeTest-362011095-project] 10.222.0.13 "GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f" status: 404 len: 111 microversion: 2.1 time: 0.030893 Jun 30 04:30:14.950728 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: [pid: 118188|app: 0|req: 552/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 30 04:30:14 2022] GET /compute/v2.1/servers/19586bdb-46bd-4857-aec4-1fac4419d56f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 04:31:04.346598 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 04:31:04.347341 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Thu Jun 30 04:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 04:31:55.540594 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 04:31:55.541671 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Thu Jun 30 04:31:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 04:34:24.357535 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 04:34:24.358418 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Thu Jun 30 04:34:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 04:34:30.395391 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 04:34:30.396670 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Thu Jun 30 04:34:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 04:35:13.445821 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 04:35:13.446837 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Thu Jun 30 04:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 04:35:15.555258 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 04:35:15.556201 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Thu Jun 30 04:35:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 04:35:29.620459 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 04:35:29.621126 dv-cinder-846842-7-iscsi devstack@n-api.service[118187]: Thu Jun 30 04:35:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 04:35:29.681532 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 04:35:29.681965 dv-cinder-846842-7-iscsi devstack@n-api.service[118188]: Thu Jun 30 04:35:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!